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The iollowing pages present a report of a seminar on examinations 
which was organised by the Inter-University Board in January 1971. 

Each university was asked to nominate two participants to the seminar. 
One of them was to be an administrator and the other was to be an academic 
person. The theme of the seminar had both these dimensions and it was 
important t(' gel both types of representatives from universities. Some of 
the admiiii5trator.s are not only competent in the secretarial and executive 
sense, they also have a wider understanding of the problem. The same 
applies to the academics. Quite a few of them are sensitive to the adminis¬ 
trative implications of the proposals made. Getting them to interact with 
each other was therefore important. As should be evident from the list of 
participants given at the end of Parti, the administrators as well as the 
academics attended in almost equal numbers. 

The remarkable thing about the seminar however was not the number 
of papers presented (a condition of participation was presentation of a 
paper) nor the number of participants, but the earnestness and the sense of 
involvement which they brought to bear on the discussions. Almost everyone 
who participated was aware that this was a problem that had been neglected 
far too long. More than one participant recalled the observation of the 
Radhakrishnan Commission made in 1949 that ‘‘if we are to suggest any 
single reform in university education, it should be that of examinations’’, 
and wondered why no progress had been made over the last two decades. 
Of course there is no precise answer to this question. Even the following 
comment made by the Education Commission in 1966 explains the situation 
only up to a point: 

“In the present system, when the future of the students is totally 
decided by one external examination at the end of the year, they pay 
minimum attention to the teachers, do little independent study through- 



out most of the academic year and cram desperately for the final exa¬ 
mination. The crippling effect of external examinations on the quality 
of work in higher education is so great that examination reform 
has become crucial to all progress and has to go hand in hand 
with the improvements in teaching.... This is one of those 
areas in education about which one can say that the problem is 
known, its significance realized, the broad lines of the solution—at 
least to begin with—arc known; but for some reason or other, an elTorl 
to implement it on any worthwhile scale or in a meaningful manner 
has not yet been made. What is needed is vigorous and sustained 
action.” (11.52) 

The call for vigorous and sustained action found a ready echo in the 
course of discussions at the seminar. Amongst other things, the seminar 
also considered the question why there was so much of talk and so little of 
action in regard to examination reform. One explanation at any rate seem¬ 
ed to be that recommendations and proposals made by committees and 
seminars on this subject are not alw’ays detailed or concrete enough. The 
seminar therefore took particular care to see that its own discussions did not 
lose touch with the realities of the situation and that whatever proposals it 
made were of a kind that could also be implemented. In plain words, the 
seminar went somewhat beyond a mere call to action. It also tried to 
evolve as far as it could, a set of practical and practicable recommendations. 
To what extent it succeeded may be Judged by the readers of this report. 

If some people think, as quite a few of them would undoubtedly, that 
these proposals make demands upon the resources, managerial as well as 
professional, of universities in a measure which is beyond them, only one 
thing can be said. If these proposals are not implemented today, the 
problem will become more and more insoluble. This is precisely what has 
happened in the course of the last two decades. What the universities have 
therefore to decide is; at what point of time do they break with the past 
and how and when they embark upon a programme of academic renova¬ 
tion? Whenever they decide in the po.sitive. whether it is today or lomi'rrow 
the programme of action which they would be required to undertake would 
be more or less as recommended in these pages. Indeed with the passage 
of time the programme of action might have to be made more stringent and 
more thorough going. There is no possibility whatsoever of its being made 
softer and less demanding. 

It seems necessary at this stage to refer to the organisation ofihe seminar 
as well as the format of the report. After the inaugural meeting the seminar 
divided itself into eight groups for purposes of intensive discussion in regard 
to specific topics. Discussion went on in these groups for a day and a half. 
Then at an interval of one day eight groups were combined into four 
groups and then into two groups. On the final day the seminar met in a 
plenary session and the recommendations made by the different groups 
were pooled and a statement, as given at the end of Part 1, was adopted. 
Before winding up its discussions the seminar nominated an editorial com¬ 
mittee consisting of V. S. Misra, Mrs. K. K, Rohatgi-Mukherjee and K. N. 
Thusu to prepare the final report. Amrik Singh and Anjni Kumar, both 
of the TUB, assisted the committee informally. The inclusion of V.S. 
Misra in the committee proved very helpful. By virtue of his specialised 
knowledge in the subject, he helped in drafting at the preliminary stage as 
also in .several other matters. 
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As it got down to the job, the editorial committee decided to prepare 
the report not only in terms of recommendations but also in terms of a 
substantial part of the discussions. Amrik Singh was authorised to draft 
each chapter which was then discussed by the members of the editorial com¬ 
mittee. Despite a number of interruptions and other pre-occupations the 
task has now been completed and is .submitted for the consideration of the 
academic community. 

As readers would be able to see for themselves, the report has been 
written in the form of an exposition as well as a commentary. Analytical 
material on various aspects of examinations is neither plentiful nor available 
easily. It was felt therefore that, to some extent at any rate, the report 
should also serve as an introduction for university and college teachers lo 
ihe range and complexity of problems that they are required to solve. 

With regard to the papers presented Ihe editorial committee had a diffi¬ 
cult job to perform. For reasons of space as well as expense, obviously 
all the p>apers presented could not be published. The committee therefore 
decided to select such papers as fitted in with the scheme of chapter formation 
as given in Part I. There was a lot of repetition and overlap amongst the 
papers presented. To tidy it up was a complex editorial job and, it is 
hoped, that it has been done to everybody's satisfaction. 

Yet another decision of the editorial committee might be referred 
to here. After some thought the committee decided to bring out the 
report in two parts. Part I contains a record of discussions as also 
the recommendations made. Part II contains a selection of the papers 
.submitted to the seminar. Part 1 is available separately as well as 
iilongwith the selected papers. 

It only remains to place on record the valuable contributions made by 
ihc participants to the seminar, each one of whom contributed a paper and 
participated in the discussions. Thanks are also due to the Ministry of 
Education for having made funds available forthe convening of this seminar. 
A considerable part of the burden of organisation and arrangements was 
carried by my colleagues—Anjni Kumar. R. R. Monga, R. K. Arora, K.C. 
Kalra, M. S. Ramamurthy, Sutinder Singh and my personal assistant R. P. 
Mehandru who cheerfully and uncomplainingly typed out the various 
successive drafts of the report. We are also indebted to the University of 
Delhi, particularly K.N. Thusu and Madan Mohan, for having collaborated 
with us in regard to arrangements and other matters. Other agencies like 
the UPSC, IBM, NCERT, IIPA. Gandhi Peace Foundation, the Delhi 
School of Social Work, also helped in a number of ways and we express 
our gratitude to them. 

At the invitation of the seminar the firm of M,<s IBM arranged a lecture- 
fivm-demonstration for the benefit of the participants. In the course of 
this lecture they demonstrated how data processing and other related jobs 
could be done with the help of machines. In addition, the library of the 
Inter-University Board organised a book exhibition consisting of 106 items 
drawn from the library of the Board. Both these features were appre¬ 
ciated by the participants. 

The report is presented to the academic community in terms of the 
suggestion made by the Education Conunission for vigorous and sustained 
action. It may also be mentioned that as a contribution towards that 
objective, the Ihter-University Board is meeting in an extraordinary session 
on October 8 & 9, 1971 at Delhi. 

New Delhi Amwk Singh 

June 16, 1971. 





V/e'come iiemaris 

AMRIK SINGH 


PROFESSOR DOSE, DELEGATES and friends: 

On behalf of the Inter-University Board of India & Cejion ] deem 
t a privilege to be able to welcome you all to this Seminar. The response 
0 it has been much beyond our expectations. As many as 81 papers have 
leen submitted. Quite some more persons who wished to participate could 
lot be accommodated for want of space. All this has only one meaning, 
rhe issue of examinations is a burning issue and needs to be explored in 
;:reater depth and realism than has been done so far. It is to be hoped 
hcrefore that this Seminar \sill be followed by a number of local and regio- 
lal seminars and, furthermore, some of the recommendations made" at 
• hem will be of a kind that can be implemented as well. 

During the last few decades cur e.vamination system has come m for 
considerable criticism. It has been described as a gamble, as a test of rote 
earning and not at all a test of anyone’s ability. The system, does not 
encourage sustained hard Work and everything depends upon one final 
.est which if a candidate fails to pass means a year lost. In terms of validity 
iiid reliability therefore dissatisfaction with the existing examination 
system has been growing apace. Various halfhearted attempt.'' hate been 
made to change the system and to make it more scientific and more reliable 
out these have not been particularly successful. There have been all kinds 
3f sociological and other reasons why some of the attempts were fore¬ 
doomed to failure. This however did not discourage everybody and 
several of them went ahead and tried to bring about certain changes. 

Most of these attempts at improvements took the form of introducing 
internal assessment. While we could not go so far as to say that the teacher 
himself shall prescribe his course, we did try to provide for assessment by 
the teacher. At the same time, a number of safeguards were introduced, 
lor instance, it was said that the internal evaluation will not exceed a certain 
given percentage of marks. Despite this and other safeguards the results 



were disastrous, except here and there and in certain professional faculties. 
Today, more than anyone else, it is the students who are opposed to the 
system of internal assessment. They have seen the system being used erra¬ 
tically if not also arbitrarily. Having seen how non-academic considera 
tions enter into the process of assessment and how results are inflated or de¬ 
flated, as the case might be, there have been active protests by students ir 
quite a few places. Outside the IITs and a few agricultural universities 
there is hardly a university in the country today which can confidently 
assert that this system is functioning satisfactorily in respect of the widr 
mass of students, and particularly in the case of afflliated colleges. 

As a matter of fact those that tried this experiment and abandonee 
itfelt demoralised in the process. A k'md of negative conclusion was drawn 
in that a general feeling came to prevail that despite all its failings ant 
imperfections the public examination was the best. If nothing more, i 
was at least non-subjective and nobody's benafides could be questioned un 
less there was a large scale leakage and the canons of secrecy were viola 
ted. This happened here and there but remedial steps could always bi 
taken. In plain words, our attempts at introducing internal assessmen 
resulted in a further strengthening and indeed sanctification of the publi 
examination system. 

Up to a point the system of public cxaminaticns has so far held it 
ground. With the increasing pressure of numbers, however, the syster 
began to break down and there are very few universities which can clair 
that there has never been a flaw or failure in its functioning. Intolerabl 
strains developed everywhere and the best that can be said about any un 
versity in the country today is that it is coping with this situation with 
fair measure of integrity and efiiciency. Problems still continue to multipj 
however. It is not necessary to go into any details in regard to these pre 
blems. As long as we are all agreed that some of these problems are coir 
plicated, and maybe, intractable, and need to be solved, it is not necessar 
to dilate upon what the agenda of work before the seminar is. 

In this connection two points of caution need to be made. One, oi 
recommendations should not assume that ideal slate of things which if 
existed would make the recom.mendations unnecessary. In other word 
to recommend that the student should be assessed by his teacher bccau 
this is the logical thing to do would be unrealistic. It would be unrealist 
because not only does it represent a complete break with the existing syste 
(and the majority would not accept it therefore) it also predicates a lev 
of academic and ethical functioning largely on the part of teachers and pai 
ly on the part of students that just does not exist. This is not to rule o 
internal assessment altogether. Internal assessment may be there but wi 
the safeguard as recommended by the Education Commission that t 
score in both cases should be shown separately. There arc diiflculties ev 
in the way of this minimal reform but given the limitations this is the be 
that can be done in the circumstances. 

There is a second point of caution too. Nobody should allow hims 
to believe that by reforming the examination system anything more th 
an important step forward would have been taken. The reform of t 
academic system is a bigger, much more comprehensive and therefore 
diflicult thing. It is important to underline this point because quite soi 
people l hink. for instance, that if students could be allowed access to hoc 
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in the examination hall, copying would disappear as a phenomenon. This 
is an oversimplified view of things. Copying and such other phenomena 
have their roots in our social and academic life and cannot be eradicated 
only by changing procedures etc. For that purpose, fundamental social 
and economic changes are required to be carried out. This however is 
neither the time nor the occasion to dwell upon them. 

It is clear from what has been said above that however we may objeci 
to it, the system of public examinations has come to stay. That being so, 
1 would like to submit that the focus of this seminar should be on how, 
given these limitations, the system can be made more efficient, more reliable 
and a better test of a student’s real ability. This may strike some people 
as an unduly timid and unadventurous point of view. To that I would 
say in reply that this is not for lack of adventure in my soul but a recognition 
of the hard realities of life. In any event, 1 am opposed to that state of intel¬ 
lectual luxury which on the one hand bemoans the present situation and on 
the other hand advocates measures and policies which cannot be imple¬ 
mented. The outcome is no other than a steady, inexorable worsening of 
the existing situation. This is precisely what has been happening over the 
last several decades. The solutions proposed have been in the nature 
of a counsel of perfection. Since perfection is unattainable, nothing else 
gets done. In my opinion this is unpardonable. Worse, it is an evasion of 
our responsibilities both as citizens and as academics. Indeed I would say 
that in terms of our academic responsibilities, the situation can be met 
only by grappling with realities as they exist and as they can be changed- 
The limitations of any change that we wish to effect are quite obvious and 
wisdom lies in staying within our limitations and then making the best of 
what i.s admittedly a bad situation. 

While the situation i.s bad ai every level, it is the least saiisfactorv 
ill the case of the under-graduate examinations. The numbers here are 
unmanageably large, mass copying has become an incredibly widespread 
problem and the holding of c.vanrinatioiis is becoming more and more of a 
nightmare for unixcrsils administrations. This is not to imply that theic 
arc no problems in respect of other examinations nor that other matters 
should not be referred to. Only I wish to submit that let this seminar 
concern itself largely with the problems of under-graduate examinations and 
a subsequent seminar might take up the other related problems. This is a 
point of view which is placed before the seminar for such decision as it 
might choose to take. 

It seems reasonable to ask at this point vvliai this seminar is likely to 
achieve. Will it only elucidate issues or will it also lead to some action on 
the part of universities? It is difficult to return a decisive answer to this 
question but tw'o tb'iigs may be said. One, to elucidate issues is important 
and indeed preparatory to any plan of action. To that extent if our discus¬ 
sions help us to understand the nature and dimensions of the problem better 
that would be a step forward. But let it also be understood that this is only 
a small step forward. The bigger and the more decisive step is that what¬ 
ever we recomnrend does get acted upon. The second thing 1 would like 
to say is that to some extent this will depend upon the kind of recomnenda- 
tions we make. If these are of a praellcable kind and do not involve a re- 
■striicturing of procedures beyond a com.forta blc point, universities would be 
ill a position to implement these proposals than ollicrwise. Speaking for 
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myself 1-would regard this seminar to have been quite successful if the fol¬ 
lowing two recommendations are made and implemented: 

{a) greater use of mechanical equipment at the office level; and 
(A) a marked improvement in the designing of question-papers. 

There is a reason Why I have picked out these two points for special 
mention. The first one I regard as almost unavoidable. No university 
that is required to deal with large numbers, say more than 15,000 students 
per year, can expect to ensure efficiency and accuracy without the use of 
mechanical aids. A few universities have already started using them. 
The rest need to be introduced to these machines. A.s a part of that intro¬ 
duction we have invited the IBM people to give a lecture-cuni-demonstration 
to the seminar. It is hoped that the lecture would be found profitable by 
everyone present here. 

The second point involves some kind of a radical brcafcwith ihc existing 
system but the reason 1 wish to highlight it is because this innovation can he 
introduced without modifying the system structurally. The outlines of the 
system would remain intact but the content of it would change. That is 
why there are difficulties in the way ofits implementation. These difficultie.s 
should not discourage us, however. It is idle to hope that innovations can 
be made without having to make fresh adjustments. Only while working out 
these proposals we should have a fair measure of the difficulties that wc arc 
likely to encounter. In my judgment difficulties in regard to the re-dcsign- 
ing of question-papers are considerable but not insuperable. My reasons 
for saying so will become clear presently. 

Purely as a practical thing 1 venture to suggest that for the ne.\t few 
years most other aspects of examination reform might be ignored and all 
attention should be concentrated upon educating the leaching communiiy 
to accept this innovation. If there is a one-poinl programme of reform, 
as is being advocated, and if the resources of the whole teaching com¬ 
munity arc mobilised, it is nottoo much to hope that it would be possible 
to carry through this innovation. 

Resistance to it would come from more than onequaner. The teaching 
community would not welcome it because it would oblige ihc general body 
of teachers to recast their whole technique of instruction. But perhaps this 
resistance can be overcome. The second part of the re^ista^L’c would come 
from the students. Given the existing academic situation the slndent.s arc 
not going to accept such a radical departure from the way things have been 
managed so far. Here the role of the academic community will become 
crucial. Without their active cooperation and involvement the thing does 
not get started. But if that involvementis there, students will come to see¬ 
the utility and significance of what is sought to be introduced. 

1 am not linking up this proposal with the introduction of the semester 
system—acomplementry reform as many people would agree. But that is 
because 1 would not like the issue of the design of question-papers to be 
contingent upon the acceptance or rejection of any other proposal. If 
both can be introduced simultaneously, that would be excellent. But if that 
is not possible, this reform must still be given top priority. 

This is not the occasion to go into the details of this innovation. But 
perhaps itwould be useful to addthat there-designing of the question-paper 
would obviously mean only a partial use of the essay type question Not 
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only that, the committees of courses which lay down the syllabus would ha\ c 
to be required to frame a large number of model question-papers, indeed a*, 
many as 20-30-40. These model question-papers can be made available to 
students at the time they seek admission. 1 can even visualise a situation 
Where anyone or more of those question-papers which have been in the 
possession of a student for a long time are required to be solved in the exa¬ 
mination hall. There can be another alternative plan upon which ] propose 
to enlarge in the courste of discussions whereby we can have a well stocked 
pool of questions out of which questions can be drawn at any time. All 
these suggestions would go to the concerned groups for purposes of detailed 
discussion. The only point I wish to stress just now is that the seminar 
would come within a measurable distance of success if it could concentrate 
on these two is.sues, particularly in respect of the under-graduate exami¬ 
nations. 

These are some thoughts which 1 have taken the liberty to present to the 
seminar for its consideration. My justification for doing .'o is the fact that 
while some of them had been presented to the intending participants through 
our circulars. I Wanted to re-present them in a certain perspective. For] am 
convinced that in terms of strategy, it is better to concentrate on limited 
objectives and then mobilise all academic and financial resources in pursuit 
of their implementation than to attack a multiplicity of targets all at the 
same time. 1 only hope that in the cour.se of these remarks I base rot in 
any way anticipated some of tho.se things that Prof. Bose propo.‘'cs to say. 

In organising this .seminar we base incurred a large inimher of debst. 
1 would leave it h.oweser to my colleague Mr. Anjri Kumar to rcferlo them 
in his remarks after Prof. Bose has spoken. ] now request Pjof. P. K. Bose 
to give his Keynote Address. 
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-Cey-Xote Accress 

P. K. BOSE , 


INTMODUCTION 

In 1949 the education commisMon headed b\ Dr. S. Radhakriihnaii said. 
“We are convinced that if we are to suggest any single reform in university 
education, it should be that of examinations". Since then various com¬ 
mittees were set up by the Governments and the universities to .siigge.st the 
necessary reforms but uptill now very little has been achieved, 

A comprehensive programme of examination reform was developed 
by Ministry of Education. Government of India in 1958 through its Central 
Examination Unit. This Unit was engaged in the task of bringing about 
reform in examinations in the country initially at the secondary stage, but 
ultimately spreading it downward to the elementary stage and upward to 
the university level. The two major goals of the programme of cxaniina- 
tion reforms were : 

Improvement of Measurement Value ; To make evaluation a more valid 
and reliable measure of students’ educational achievement, in varied 
aspects, in respect of predetermined educational objectives. 

Enhancement of Pedagogical Value: To make evaluation an instrument 
fdr producing the desired influence on various aspects of education and 
thereby to contribute towards their qualitative improvement. 

To achieve these goals the programme of work was spelt out in five 
well defined work areas (1) research, (2) training, (3) extension, (4) develop¬ 
ment, and (5) publications. This programme continued for a decade but we 
are unable to notice its impact on the examination system in the country 
except marginally. 

The University Grants Commission appointed in 1958 a committee of 
persons with special knowledge and interest in this subject to make a tho¬ 
rough study of the problems involved and propose remedial measures. 
This committee also gave its recommendations. During the period Dr. 



B. S. Bloom of the University of Chicago was engaged in directing ‘Work¬ 
shops’ on evaluation in Secondary Education under the auspices of the 
Ministry of Education. 

These endeavours also did not produce the desired effect on the exami¬ 
nation system. The same old system is continuing with practically little 
change and even where some steps have been taken, such as internal assess¬ 
ment, semester, etc. there also, ultimate result is not satisfactory. 

The main reason why the serious attempts made earlier did not produce 
the desired effect, is perhaps due to the unfavourable condition present in the 
country for implementing such reforms. It is essential to emphasise that 
each country should try to formulate its own programme of reform and 
should not copy in full any measure accepted by other countries. While 
each of these is bound to bear a family resemblance to the body of basic 
principles in the matter, specific steps to be taken to meet the situation in 
each country will necessarily differ. 

The field of higher education in India is passing through revolutionary 
transition because of two important factors, the first is the pressure of num¬ 
bers and the second is the social and political awareness among the students 
regarding their rights. 

In 1947, the total number of students in the universities and colleges 
was about 2 lakhs (which is now the student population of the Calcutta 
University alone) and now this figure has increased to 22 lakhs. Due to the 
increased political activity in the country attitudinal transformation ha.s 
taken place amongst a certain section of students and teachers, 

Whatever reforms we propose to introduce will be vitiated if they are 
not pursued conscientiously. At the present moment we find ‘crisis of char¬ 
acter' among people including teachers. In this connection 1 reproduce a 
few lines from an article written by Prof. S. V. C, Aiya, Director N.C.E.R.T 

“In the last two decades, we have, knowingly or unknowingly corroded 
the steel frame. It is now collapsing like a pack of cards. Teachers of to¬ 
day are no longer missionaries but mercenaries. Their primary concern is 
money and material comfort. They do not believe in hard and sustained 
work, but in leisure and more ofit. if possible (strikes provide unofficial vaca¬ 
tions). To many of them, teaching is an infliction to be put up with as a 
necessary evil. They arc mostly concerned with supplementing their in¬ 
comes. The salary is, perhaps, a retention fee or pension. They have them¬ 
selves very little by way of discipline. Punctuality has become a dictionary 
work. Intensity of work in the class is something only one hears about." 

The success of implementing the proposed reforms depends on the sense 
of duty, devotion and honesty of teachers, students and administrators. 
Without this all our efforts w'ill be futile. 

PJlOPOSnD changes—SHORT TERM 

It has been accepted by all concerned that e.xaminatioii (in some form) 
is necessary. Newton’s First Law of motion states that everybody conti¬ 
nues to his state of rest unless compelled by impressed forces to change that 
state and examinations serve to supply these forces and make the student 
move forward in his intellectual development. Broadly speaking the aim of 
education is to implant habits of intellectual discipline among the pupils. 
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make them intellectually alert and bring out their latent abilities. But un- 
Ibrtunately we treat examinations only for evaluation purposes. 

When we discuss the problem of reform of examinations, we deal with 
large scale public examinations. It consists of two parts (/) operational 
and (//) functional. Doth are equally important. 

At present large scale public examination is exclusively conducted by 
the universities. This practice should be changed to bring about decentra¬ 
lisation of powers and functions, placing the responsibility squarely where 
the functions are being performed, while retaining a number of supervising 
and regulatory functions on the central authority. The proposal is to trans¬ 
fer the task of conducting the preimiversity and degree examinations from 
the universities to the aftiliated colleges. 

The scheme that we have proposed is based on a new system of decen¬ 
tralisation. It is that the affiliated colleges should have more responsibility 
placed on them. Theyha\emuch more intimate contact with the students 
than a distant university administration and their teachers are in constant 
touch with the boys and girls. So naturally these teachers and authori¬ 
ties of the colleges should be given the added responsibility for the conduct 
of examinations. Large scale copying in the examination hall has become 
a serious evil and unless it is checked, the vhole examination system will 
break down. If the examinations are conducted by the colleges, this will 
secure greater involvement of the teachers in the examinations. Only 
when the teachers stand united and determined they will be able to stop 
the malpractices by their students. For unisersilies like Calcutta it is be¬ 
coming impossible to conduct the examination for such a large number of 
students. Decentralisation of authority as envisaged abose will ca.se the 
situation to a considerable e.\tent. There arc no doubt a number of dilli- 
culties involved in this process but the dilficiiltics can be surmounled 
with experience. 

Large scale public examination may be regarded ns group (csis. The 
three important functions of educational tests arc: 

1. selection and distribution, in which tests arc used as a basis for the 
selection of students for programmes; 

2. diagnosis or prescription where tests arc used as a basis for identi¬ 
fying the nature and extent of educational deficiencies: 

3. evaluation where tests are used to a.sse.ss the efTectiveness of educa¬ 
tional programmes. 

The present examination system deals only with 3. Some attempts 
were made to construct tests for L 2 but that did not meet with success 
With the present number of students in the affiliated colleges it is difficult 
to conduct frequent examinations. Continuous assessments are necessary 
for identifying the nature and extent of educational deficiencies but the 
number of students and the environmental conditions prevalent in the 
country stand in the way. Some steps should be taken immediately so that 
the method of continuous assessment can be introduced in colleges. While 
considering this urgent problem we should bear in mind that this is one of 
the important reforms ofexamination which we cannot afford to overlook. 

Evaluation in education is presently limited to large scale written exa¬ 
mination. These written examinations suffer from some serious .short¬ 
comings (a) emphasis on memori.sation, 
fb) subjectivity. 





(c) poor content average, and 

(d) administrative issues. 

By taking remedial measures, some of the defects of the written exami¬ 
nation may be removed. Questions set now mostly require recall of inform¬ 
ation and overlook other objectives. This defect can be overcome by the 
proper selection of instructional objectives and givingp-oportio iate weigh- 
tage to each of the objective for framing questic ns. Subjectivity in ca ;e 
of written examinations can be reduced by developing eesigu of the ques¬ 
tion paper by the administrative authority. In the design specific directions 
should be given regarding the dimen''.ian of the question paper and the re¬ 
lative weights of the objeclievs Poor content coverage can be improved 
upon by introducing short answersand objective type questions. Forputting 
these into practice teachers should be more serious in their pursuits and a 
.special research unit on examination should be created in each affiliating 
university. The whole job as ment'oned above is a highly technical one, 
and can only be performed by a group of scientifically trained personnel. 
Before we can introduce such reforms in examinations, we have to make 
education more purposeful. For this purpose the existing curricula and 
syllabi should be scrutinised and the corresponding changes be introduced 
in the teaching methods. 

Of late we hear about open-book examination where student can con- 
,sulf his books or informal manual and synthesize his knowledge to write an 
answer. I do not think that immediately such an examination is practicable 
in India. In large scale public examination, we need a large number of 
examiners for asse.ssment. E\ en with a scoring key there will be wide varia¬ 
tions in marking. This is due to the fad that the scale parameters of differ¬ 
ent examiners are diflerent. This can be avoided to some extent if the marks 
are given on a 5 point scale i.e., the present method of scoring by a fixed 
number is replaced by an interval score. 

On the whole a harmonious combination of questions requiring objec- 
ti\c answers as well as answers of the essay type, oral examinations (when 
practicable) and assessment of departmental records would be the ideal. 

PROPOSED CHANGES—LONG TERM 

I have indicated above some of my ideas regarding impro\eiuent of the 
present day examination system on a short term basis. On a long term basis 
we should reform the examination system in such a way that the present 
emphasis only on evaluation aspect is considerably shifted. By this I do not 
mean that w'c should get rid of all types of assessment. It is desirable to lay 
more .stress on diagnostic function than on evaluation function of an exami¬ 
nation. Real purpose of education is to make students intellectually alert 
and to bring out their latent abilities. This aspect is often missed. Now the 
question of pass, fail has assumed great importance and because of this, 
there is such widespread malpractice throughout the country. 

According to me the universities should conduct examinations at the 
time of admission and not at the time of leaving. All students should be 
given a certificate describing their attainments in qualitative and quantita¬ 
tive terms without mentioning pass/fail on the basis of continuous assess¬ 
ment, Potential employers may if they so desire conduct special tests for 
recruitment- We .should all try to change the present mental attitude and 
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for this purpose we seek the co-operation of the Government and the general 
public. 

This practice is being followed by several countries and it has met with 
success. In this connection I may quote a few lines from‘the Swedish Sys¬ 
tem on Examination'. 

“The question of pass/fail has been of very little meaning for more 
than 20-30 years in the Swedish school system. We have for many years in 
fact got rid of the problem of pass/fail and we have had all students ranged 
according to scale and they have all had their certificates so to speak”. 

I reproduce below the system of examination and marking methods in 
U.S.S.R. 

(a) Examinations : An important form of evaluation of students’ 
achievement remains the examination.^ 

At present examinations are held only twice—at tlie end of the 8th and 
10th years of schooling. 

Both the inter-stage exam—in class 8—and the exam for the G.C.E. 
are important events in Soviet school life though the system is not examina¬ 
tion-oriented as it may be the case in other countries. 

The subjects in which examinations are held (in oral and written form) 
are given in the following table. 


TABLE 

Examinations in Soviet SehooL' 

Class 8 Class 10 Toial 

Subject — --- - minik'i 

Oral Wrillcn Oral Wrillen 

Mathematics 

Algebra and Trigonomeli s 
Geometry ■ — 

Physics 
Chemistry 
Russian language 
Russian language and litcriituic 
History and Social .Service 
Foreign language 

Total 2 


At oral examinations, students choose one from 25 to 30 so-called exa¬ 
mination tickets which contain three or two questions. The questions are 
constructed by the Union Ministry of Education* and are circulated among 
schools about two months before the examinations are due. 

*Few, perhaps, know that in the first years afier the 1917 revolulion, there were no 
examinations in Soviet schools at all; they were abolished b) a government decree. In 
later years, on the other hand, students were (o lake examinations in almost each subject 
they studied. 

*In national republics where there are also schools with local languages as the me¬ 
dium or instruction students are also examined in the mother longue and literature. 

'Except for tickets on the mother tongue and literature which arc conslriiclcd by 
Education Minisleries of Union or autonomous rcptiblic.s. 
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Both examinations are interaal examinations though officials of Educa¬ 
tion Boards, students committees and representatives'of public organizations, 
such as the Young Communist League, etc., are often present at the exami¬ 
nations. 

However, the assessment is done either solely by the class teacher, who 
is normally the examiner, or by a committee of two teachers of the same 
subject. The latter case is a common practice in assessment in exami¬ 
nations for the G-C.E. 

As one might have already guessed, current assessment as viewed in 
Soviet schools ensures that examinations alone do not play the decisive role 
in the total assessment of the student’s performance in school. Therefore, 
no sudden failure (or display brightness for the matter) is usually expected. 

The examiner is entitled to allow, in contradictory cases, the candidate 
to have another go, or to mark the answer taking into account his past 
record. 

Students, thus, are not unnecessarily fearful of examinations. At the 
same time, examinations retain their role as a powerful means by which 
consolidation of student knowledge is achieved. Again, students themselves 
are interested in better mark as the weightage informally allotted to exami¬ 
nation results is roughly about 30 to 40 p.c. of the final mark entered in the 
8-year school certificate and the G.C.E. For the top student each ‘‘4” or 
‘■ 5 " earned by him in final examinations is of particular significance: gold 
(or silver) medals^ arc awarded only if he managed to get “5s” or “4s'’ in 
all the exams he has taken and provided his final marks are not lower. 

fb) New Trends : Though, w'ithin the scope for which it was intended, 
the system of c\a1 nation practised in Soviet schools has been adequate, there 
have in recent years emerged factors calling for a diversification of 
the system. 

Marking : The system of marking the student's performance is rather 
simple. It is a five-mark system, the mark “one" being the lowest while 
the ‘‘five" being the highest. The lowest mark is however, used very sel¬ 
dom. The "3", roughly corresponding to “fair", is the pass mark. 

At the end of a term (or semester in classes 9 and 10) integrated marks 
are allotted on the basis of marks for current work and written tests. 

SUMMARY 

1 summarise below the main points for reforming ‘Examination’. 
Short Term-. 

(n) Decentralisation of large public examinations should be accepted 
as principle. 

(/)) On the whole a test should consist of essay type and also objective 
type of items. The structure of the question should be properly 
designed. 

(c) Whenever possible the assessment should be on the basis of written, 
oral (whenever possible) and class records. 

(rO Marking system should be changed from point to interval. 

‘The iiwJrileis. olher factors being equal, have an edge over other c.iiiciidales at 
university admission examinations- 
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Long Term: 

(a) Present method of examination should be replaced by continuous 
assessment, i.e., laying more stress on diagnostic aspect than on 
evaluation. 

(b) Assessment should be done by internal teachers. 

(f) There should be no general ‘Pass’ or ‘Fail’. 

(d) All internal assessments alongwith the courses of study should be 
clearly stated in the certificate of completion. 

(e) For fresh courses of study and for recruitment, special tests may be 

held, if necessary. 
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""go's o: Assessment 


1 r IS wiDLLV assumed that human performance can be measured on a quanti¬ 
tative scale. In educational parlance, the term ‘Assessment" usually refers 
to the process of allotting a quantitative value to student's achievements. 
All types of achievements cannot be assessed by one single method. Several 
methods of assessment are therefore used. In technical terminology, these 
methods are called "Tools of Assessment". 

t ORMLLATION OF OUJtCTIVES 

Assessment cannot be accurately done unless it is known whai is to be 
assessed. For this purpose, a precise formulation of the objectives of the 
educational programme is necessary. The formulation of objectives is a 
difficult but an indispensable step. The objectives can be classified in two 
categories: (t) the content objectiscs. and (//) the behavioural objectives. 

The content objectives should specify the course content to be covered 
in the class. The behavioural objectives should specify knowledge, abi¬ 
lities, attitudes and skills that ought to develop on successful learning of the 
content of the course. The abilities and skills, etc. should be 5p:cified in 
terms of improved performance of the students. That is, it must clearly 
show the difference between the performances of the students who possess 
that ability and those who do not possess it. For instance, unless the ob¬ 
jective “critical thinking" is specified in terms of improved performance, it 
is likely to be differently interpreted by different people. 

The seminar had a good deal of discussion on the subject of the formu¬ 
lation of objectives. It recommended that the respective board of studies 
should clearly define the objectives of education in each subject, course-wise, 
in terms of course content and al.so in terms of qiialiiics that a student is 
expected to develop on the completion of the course. The existing svllabl 
ou\d be exmmti rwoiiv’M^, 's'wtwser weeded, vn v’ne ot vhese 



objectives, for the formulation of objectives the boards of studies may con¬ 
vene seminars of subject teaphers. It would be helpful if a few experts on 
testing are associated with these seminars. 

As all the objectives may not be equally important, the board of studies 
should determine the weightage to be given to each objective in the exami¬ 
nation. 

SELECTION OF TOOLS 

Once the objectives and their respective weights arc determined, it 
would be easy to select appropriate tools of assessment. At present the 
following tools are mostly used in our examinations. 

Paper-pencil tests : Paper-pencil tests are those Le.sls which require 
students to write answers in their own language or to mark any of the al¬ 
ready given answers in the text booklet. The following types of test.s may 
be considered as paper-pencil tests. 

Essay type test : These tests are considered appropriate for measunng 
such educational objectives as coherence of ideas and style of expression. 
They provide an opportunity to a student to project his personality. They 
also enable the examinee to follow the thinking process of the student's mind. 
But they sutler from several linvitations. For instance, marking in es.sav 
tests is known to be subjective and less reliable and the course coverage 
patchy as well as inadequate. They encourage selective studv. Several 
Indian studies have shown that in traditional essay tests, students can answer 
the required number of questions even after neglecting approximately three- 
fourths of the course. Further, to some extent, achievement in essay tests 
depends on speed in writing and good handwriting. It was probably 
in view of the limitations of essay tests that the Radhalcrislinan Commission 
(p. 336) observed: 

“The essay-type of examination which prevails at the degree stage, as 
elsewhere, suffers from some major defects. It has usually no clearly 
defined purpose; it is. therefore, invalid. Its sampling is very arbi¬ 
trary and limited: it is inadequate. Its scoring is subjective and there¬ 
fore not reliable.” 

To make the best use of the essay test the following measures have 
frequently been suggested ; 

(/) Specificity in questions. That is. the question is to the point and 
does not permit a .student to write of anything other -than what has 
been asked. 

(if) Elimination of choice. 

Short-answerjstructured-type test: The structured-type questions re¬ 
quire students to give short answers to each of .several questions all con¬ 
cerning the same topic. Because of the special nature of these short ques¬ 
tions some people give them a distinct nomenclature "structured-type’'. 
Others include them in the broad head of short answer questions. 'The.sc 
questions inherit the characteristics of the essay test in the sense that they 
also provide freedom of respon-sc. These tests have several advantages. 
Since they require short-answers, they cover a wider area of the course con¬ 
tent and objectives than is usually covered by the traditional essay test. 
The marking in these tests is usually less subjective. They have been found 
to be as reliable as most objective tests and are probably more valid for 
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some purposes. Most experts on testing feel that there is no empirical evi¬ 
dence to suggest that the qualities asses^ by essay tests canot be assessed 
by short-answer tests. 

OBJECTIVE TESTS 

Most of the educational objectives currently measured in our exami¬ 
nations can be assessed by more extensive use of objective items. In 
deed carefully designed objective items may measure even such higher 
mental abilities as critical thinking, appreciation, etc. This has been done 
quite extensively in other countries and there is no reason to think why it 
cannot be done in our country. The widespread prejudice against objective 
tests in 1 ndia arises from the fact that in the eyes of some people objective 
tests can be easily framed by laymen. This is not so. It requires consider¬ 
able skill and experience to frame them. Answering them is equally exact¬ 
ing in so far as answers have to be given within the time limit laid down for 
this purpose and that demands concentrated effort. Furthermore, there is 
hardly any choice in these tests and this imposes a kind of intellectual disci¬ 
pline which is unique in itself in the present conditions. 

Objective tests thus have several advantages. They co\er(i) a far wider 
area of the course than is covered by essay-type questions or short-answer 
tests; (i/J scoring i-- easy, objective and accurate. However the critics of 
these tests hold that these do not give an opportunity to the student to ex¬ 
press his idea.s. Furthermore, there is no conclusive evidence to suggest 
that the ability to select the right answer is the samething as the ability to 
compose the right answ er. 

Hating considered the pros and cons of the use of \arious types of 
paper-pencil tests, the seminar came to the following conclusions: 

(Ij Every university should have a phased programme of reducing 
the predominance of essay-type questions. This can be done 
by arriving at a suitable proportion of essay-type questions as also 
objective-type, short-answer and structured-type questions in the 
examination. The proportion will depend to a great extent on the 
nature of the subject and the level of the course and this aspect 
be left to be determined by the universities. 

(2) The boards of studies may suggest the principles on the basis of 
which the examiners will select the various types of questions. 
To help and guide the candidates as also to facilitate the task of 
paper-setting, concrete examples of different types of questions 
suitable to test different types of abilities may be provided by the 
board of studies. 

(3) Evidently these reforms cannot be carried through forthwith. It 
stands to reason therefore that the improvement in the designing 
of question-papers should be given the topmost priority. For this 
purpose, a phased programme of improvements spread say over 
live years may be drawn up. 

As a preliminary step, it is strongly recommended that traditional 
essay-type questions may be broken up into short answer and structured 
type. As a transitional step however, certain other steps also need to be 
taken. These may be listed as follows: 

(4) The convention of not repeating questions from the question- 
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paper of preceding years encourages the practice of selective 
study among the students. This is academically unsound and 
needs to be discouraged. 

(5) Another measure which contributes to the habit of selective study 
is the provision of a large number of alternatives in the question- 
papers. While sometimes there may be sound academic reasons 
for such a practice, it is particularly in the essay-type questions that 
this practice is most often encountered. In objective type, short- 
answer type and structured-type tests the element of choice is 
almost non-existent. Since the intention is to minimise the element 
of choice, every care should be taken to ensure that the number of 
alternatives is restricted and each alternative question (wherever 
found necessary) assesses the same type of ability, requires approxi¬ 
mately the same length of answer and has approximately the same 
difficulty and discrimination value. 

(6) It would be helpful if the length of the probable answer in terms 
of words is fixed for essay-type questions. 

(7) As a corollary to the foregoing it may be emphasised that instruc¬ 
tions in the question-paper should be so clear and so precise that 
there is no room for different interpretations either by the students 
or by the examiners. 

(8) As far as objective-type questions are concerned, it is adsisabic 
to administer them separately and strictly within the prescribed 
time limit. 

POOL or QUESTIONS 

No reform in examinations i.s possible unless leachers as well as 
Students are involved inxery large numbers. The existing system is 
so firmly established that to change it even in minor mailers requires 
enormous effort. And if the change intended to be carried out relates 
to the re-designing of question-papers, the amount of resistance en¬ 
countered will be e.xtraordinarily all-pervasisc and persistent. To [a) o\er- 
come these difficulties, to ( h) impro\ e the tone and content of leaching and 
to (cj facilitate changes in curricula, a new idea wa.s mooted and it dcser\es 
serious consideration. 

The idea is not all that new. in a manner of speak'ing. Today the sylla¬ 
bus is laid down by a committee of courses consisting of a small number iif 
people while the actual teaching is done by the wide mass oftcaclicrs. (The 
situation being what it is. it is difficult to visualise a change in it in the near 
future). In regard to the syllabus however, if has already been suggcstetl 
that in addition to what is done at present the objectives of instruction should 
be formulated clearly and in some detail. This would be a break with the 
existing system. Perhaps this can be carried out relatively easily. 

The next step is more difficult and more open to controversy, .\ccord- 
ing to the prevalent practice, a paper-setter in a certain subject is appointed. 
He sets the question-paper and sends it to the university. In certain case.s 
it is moderated. In certain other cases it is printed without anyone having 
a further look at it. The crucial change proposed is that the papcr-setlcr 
while drafting his question-paper need not operate exclusively on his own 
resources. Instead his main job should be to select quc.stinns with due em- 
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phasis on spread, internal choice, relative emphasis on different types of 
questions, etc. from a pool of questions maintained by the university on an 
on-going and continuous basis. The mechanics of the arrangement can be 
somewhat like this. 

The detailed syllabus (which will include a clear formulation of the ob¬ 
jectives of that course) as drafted by the committee of courses will be circu- 
lated to all teachers. They, in turn, will be invited to frame questions in 
relation to the syllabus. TTiere will be no restrictions on the number of 
questions that they may frame. In fact the larger the number of questions 
framed, the more extensive will be their participation. All the questions 
thus framed will be sent to the university office and presented to the com¬ 
mittee of courses at its next meeting. Obviously quite a number of these 
questions will be repetitive. These can be deleted. In the case of the rest, 
if found suitable in relation to the objectives of the syllabus already formu¬ 
lated and circulated, these would be put on the list of approved questions. 
A considerable amount of editing and classification will required. This 
would be necessary so as to put ever 3 rthing on a systematic basis instead of 
having it in a haphazard manner. In other words, pre-testing of questions 
would be an important condition which must be fulfilled before these are 
included in the pool. 

An important aspect of this scheme is to treat it not as a once-in-a-life- 
time-affair. That would be to completely misunderstand the objectives of 
the scheme. The scheme requires, as a matter of fact, that, as a part of 
their instruction, the teachers should keep on framing questions in colla¬ 
boration with their students and that this exercise is undertaken not only 
once in a year but repeatedly and at intervals. Indeed some of the questions 
framed earlier can be rejected and new ones framed after some time. This 
will indicate not only a greater sense of participation on the part of teachers 
and students but also a deeper understanding of the subject on the part of 
both. 

These questions would belong, according to the scheme, to the various 
categories suggested above. There would be essay-type questions, short- 
answer questions, structured questions, objective questions, indeed all 
the various categories enumerated in the foregoing pages. In the pool of 
questions maintained by the university office, the questions would be also 
classified under these various heading and maintained accordingly. As a 
matter of fact, it is visualised that the larger the number of questions the 
easier it would become to carry through any innovations that might be decid¬ 
ed upon. Sometimes the number of such questions may run to hundreds 
and this, so to speak, would be a measure of the success of the scheme. 

Most crucial to the whole scheme is the involvement of students in the 
formulation of questions. Teachers are accustomed to designing questions 
for their students as a part of their normal work. What is proposed now 
however is that students too, and in larger and larger numbers, should be 
associated with this task. Thiscan be done inmore than one way. Teachers 
can formulate questions and try them out on their students. Wherever 
necessary they can amend them in the light of students' performance and 
criticisms received. Alternatively students themselves may propose ques¬ 
tions and those can be tried in the class and finally adopted for inclusion in 
the proposed pool of questions. This will al.so help in the pre-testing of 
questions referred to above. 
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Should these questions be regarded as completely conlidential or should 
these be public property? Opinion was divided on this question. Those 
in favour of making them public maintained that if a student knew the 
answers to all the questions in the pool nothing better could be expected 
from him. Others countered by saying that in regard to certain types of 
questions, mainly relating to application of knowledge to new situations, 
keeping them confidential was desirable. No unanimous decision could be 
arrived at in the matter. A kind of consensus was however reached whereby 
if the pool of questions was extensive and the number of questions included 
was several hundreds (thousand if they are of this objective type) nothing 
would be lost by making them public. 

As should be evident from the details of the scheme (and these are mostly 
tentative in character), the principal responsibility for initiating and carrying 
the change through would devolve upon the committee of courses. In 
other words, leadership has to be provided by a group of knowledgeable 
and forward-looking people. If a few of them can come together in a cer¬ 
tain committee and are vested with the power of laying down the syllabus, 
formulating the objectives of study, processing the very large number of 
questions received from teachers and students, the most decisive step in 
favour of change would have been taken. But if anyone of these pre-condi¬ 
tions is either missing or if the persons involved are weak in motivation and 
strength, the possibility of accomplishing the change would to that extent 
diminish. 

Two further points may be made here. Since there will be a large range 
ofquestiorrs to choose from, the task of the paper-setter would be consider¬ 
ably simplified. Instead of having one or two question-papers set by him 
it should be perfectly feasible, and convenient as far as he is concerned, to 
have a larger number of question-papers set. Any one of these chosen at 
random can finally be printed. Another variation on this proposal could be 
that in order to minimise the chances of mass copying, a problem which has 
assumed serious proportions in recent years at certain places particularly at 
the under-graduate le\el. a number of difiereiu question-papers (with almost 
the same difficulty value) are distributed simultaneously to examinees in a 
hall. Since students sitting next to each other would be solving different 
question-papers, the chances of their communicating with each other would 
diminish, if not disappear. 

Whatever has been said above applies to other forms of testing, such as 
practicals, oral tests, etc. Whether the question-papers thus set arc also 
required to be moderated or not is an issue that needs to be examined. If 
it is maintained that the pool of questions has already been sifted and, in a 
sense, moderated by the whole committee and that the question-paper is 
drawn primarily from that pool of questions, moderation does not .seem to 
be all that incumbent. On the other hand, it can be argued that moderation 
is concept of much wider significance and therefore these question-papers 
also ought to be moderated. On balance the seminar wa.s in favour of the 
latter point of view. 

MODEKATION 

Whether the foregoing proposal of a bank of questions is implc- 
nicnlcd by every university or not, it is importaiu that before a ques¬ 
tion-paper is said to have been finalised .someone other than the paper-setter 
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should carefully scrutinise and review the question-paper. This is impor¬ 
tant because moderation of question-papers requires a special kind of skill 
both in terms of knowledge of the subject and in judgement. Instances are 
not unknown where question-papers have been criticised for all kinds of 
reasons. In certain cases reasons are easily identifiable. Sometimes, for 
instance, questions get included when this is not justifiable either in 
terms of the syllabus or in terms of the coverage of the syllabus. There 
can be a number of other points of criticisms as well into which it is not 
necessary to go at this stage. 

What is sought to be emphasised is that without the right kind of bala¬ 
nce and judgement which a moderator is competent to exercise, the question 
paper as finally composed may not be exactly of the right standard. While 
it is not easy to quantify or to be precise about it, there is also the element 
of comparative standards. Arc question-papers set at one university ap¬ 
proximately of the same standard as those in another university with which 
its degrees are sought to be put on par? First-hand knowledge of standards 
and practices in other universities therefore is one of the essential attributes 
of anyone who is entrusted with the responsibility of moderating question- 
papers. 

Not all universities in India and Ceylon provide for moderation. The 
general feeling at the .seminar was that wherever such a provision does not 
exist it ought to be introduced. The principal jobs of a moderator may be 
defined as follows : 

(fl) He should ensure that the question-papers set in that university 
are appro.ximately of the same standard as those in other univer¬ 
sities with which its degrees are usually equated. 

(/)) The paper-setter neither o\cr-emphasises nor under-emphasises 
any part of the syllabus and that the objectives as laid down by the 
committee of courses are faithfully observed in practice. 

(cl In respect of distribution, internal choice, balance among difierent 
types of questions (such as essay-type, short-answer, etc.) clarity 
and precision of instructions and all such other matters, every 
little detail has been taken care of. 

Evidently these responsibilities can be discharged only by a person who 
is involved with the teaching of students. This is not to rule out external 
examiners altogether. Certain universities have a board of moderators. 
In terms of composition these boards have at least one internal examiner 
and one external examiner. There can be an additional one or two members 
but that is a matter of detail. 

One of the proposals made as a part of the pool of questions was that 
when question-papers are prepared quite a number of them must be got 
prepared at the same time. Once that proposal is accepted, the board of 
moderators need not be called upon to meet so very often as might be sug¬ 
gested by the foregoing recommendations. In point of fact the board may 
have a core membership of two people, one internal, one external, whereas 
the rest of the members can be rotated so as to be able to deal with the 
various levels of examinations, undergraduate, honours and master's degree. 
In plain words, the very same external examiner who is called to attend the 
meeting of the board of moderators can be asked to spend a little more time 
on moderating additional question-papers. In ihe case of internal exa- 
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miner/s, there should not be any serious difficulty with regard to his/their 
availability. 

REVIEW OF QUESTIONS 

A word about the review of question-papers set also seems to be 
called for. After the examinations are over the members of the board 
of studies and the Examination Research Unit of the university establish¬ 
ment which is one of the strong recommendations of the seminar 
should review the questions. This may be done from two points 
of view. One, an assessment of the question-papers set should be under¬ 
taken. Was everything as laid down hy the boards of studies and in terms 
of the formulation of objectives? Was moderation successful and skil¬ 
fully conducted? To what extent the phased programme as drawn up is 
being fulfilled in practice? There can be a whole host of issues which need 
to be discussed between the boards of studies and those vested with the res¬ 
ponsibility of conducting research in the system of examination in a uni¬ 
versity. 

The second point of view from which this review can be undertaken is 
that of the performance of students. This will reveal a good deal about the 
kind of instruction and guidance that they had as also the kind of preparatioii 
that they made for the examination. To review the question-papers only 
from the preceding point of view would be somewhat misleading. The 
performance of students is equally important. As a matter of fact the review 
from this point of view might also conceivably involve the participation of 
the wider mass of teachers. It is they after all who are doing the actual 
teaching. Unless the results of this review are therefore brought to their 
notice and they have a feeling of participation, the results are not likely to 
be particularly useful. 

The results of such a review must be disseminated as widely as possible. 
Paper-setters, moderators, teachers, students, indeed everyone concerned 
with the whole process of education, should be informed of these findings. 
The more important of these findings may be published in the annual report 
of the university as well. 

Paper-setters : At present the boards of studies perform two functions. 
One relates to the framing of syllabi and the other to the appointment of 
paper-setters and examiners. For reasons both historical and sociological, 
the second function receives more attention. It is idle to expect that a mere 
recommendation by a seminar would change this state of affairs. It is 
important nonetheless to emphasise in this context how the appointment of 
paper-setters needs to be viewed differently. 

As will be noticed, a distinction has been drawn between the appoint¬ 
ment of examiners and that of paper-setters. Examiners have to be appointed 
out of those who are engaged in teaching. While they too will require 
some orientation in the new modes of assessment, the principal responsibi¬ 
lity of implementing the changed policies will fall upon paper-setters. To ap¬ 
point the right kind of paper-setters therefore is of crucial significance to the 
success of the whole scheme. So far, the chief consideration in most cases 
is the seniority of the teacher concerned. Without decrying this practice 
in a wholesale manner it needs to be stated unambiguously that this consi¬ 
deration will have to be abandoned if the re-designing ol' question-papers 
is to be made effective. Only those people who arc in tune with the new 
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Hpproach would be the appropriate persons to be appointed paper-setters. 
Jn certain cases some of them may be senior in terms of their standing in the 
profession. In certain other cases this may not be so. It goes without say¬ 
ing that the overriding consideration in this instance should be their compe¬ 
tence for the job. The seminar therefore recommended that in addition to 
possessing knowledge of the subject and the mental make-up of students who 
are expected to appear in the examinations, the paper-setters must neces¬ 
sarily have the right kind of orientation for introducing those changes which 
have been recommended above. 

To some extent the situation will differ in respect of under-graduate 
and post-graduate classes. In working out guidelines for action therefore 
Ihi.s aspect of the situation may be given its due importance. 

TRAINING or PAPER-SETTERS AND MODERATORS 

As of today, the number of people who are conversant with the new 
techniques of examinations is not large. While many are vaguely aware 
that something needs to be done to change our system of examination they 
do not have precise enough ideas. When it comes to re-designing question- 
papers, only an exceedingly small number would have the requisite know¬ 
ledge or training. But if the system is to be changed a very much larger 
number of teachers woud have to be given the requisite training. For this 
purpose some organisation has to undertake the job of training paper- 
setters and moderators. 

The most appropriate body for performing this task would be the Cen¬ 
tral Unit regarding which details are to be found in the last chapter. But 
I ill such time that such a Unit comes into existence, or maybe even after 
that, theUGC by virtue of its resources would have to play a crucial role in 
the organisation of .such training programmes. As a preparation for thi.s 
kind oftraining it would be useful to have a manual written in non-technical 
language explaining in detail the procedures of framing suitable questions in 
terms of the new system recommended here. Perhaps the Inter-University 
Board can undertake to have such a manual prepared. 

nOOKLETS ON TESTING 

Most of what has been recommended here is unfamiliar to teachers 
as well as to students. Unfamiliarity provokes a kind of resistance 
which has to be overcome before innovations get widely accepted. This 
is as much true of the system of examination which is under discussion 
as of several other things in the academic field. The first respon¬ 
sibility of the proposed Unit should therefore be to educate all those who 
feel committed to the existing ways for no reason other than this that they 
have not known anything different. Once this state of unfamiliarity is over¬ 
come further progress becomes much easier. A tentative suggestion in this 
regard was one in respect of the pool of questions. Yet another can be a 
■'■ystematic campaign through books, pamphlets, seminars, lectures, etc. 
to inform all those who at present are un-informed. 

An important role in this campaign can be played by boards of studies 
i a vari ous subjects. If they formulate their objectives clearly, prepare mod el 
questions and in a few cases also model answers, and these are put in the 
hands of students as well as teacher.^, a crucial step forward would have been 
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taken. Most of the boards of studies today function casually as also spas¬ 
modically. TTiis needs to be changed. Instead, the boards of .studies .should 
be required to assume the role of the prime agents of change. 

It is naive to imagine that other countries which have carried through 
some of the.se changes did not encounter resistance. Resistance to change 
is unavoidable, unless it can be overcome through planned and systematic 
efforts to combat inertia. Preparing these booklets on Testing and circu¬ 
lating them widely and involving both students and teachers in large num¬ 
bers is a pre-requisite for any change that has to be introduced. The semi¬ 
nar therefore attached the highest importance to the preparation of such 
booklets, their di.ssemination as well as their extensive use. 

PERFORMANCE AND ORAL TESTS 

There are certain educational objectives which cannot be tested 
legitimately as well as adequately by paper-pencil tests. Ability to take 
part in discussions and skill in handling instruments are such objec¬ 
tives. In order to assess a student’s achievement in respect of these 
objectives, tools like practical, tutorials, dissertations, seminars, etc., 
are used. Owing to the very nature of such tools these are, further¬ 
more, considered appropriate for purposes of internal assessment. And 
appropriately loo, the use of these tools is open to the same criticisms as is 
usually advanced against the system of internal asse.ssment. While the 
system of internal assessment would be dis ussed in some detail in the next 
chapter, performance tests, at least in one regard, are imperative. No 
science student can be said to have learnt even the elements of his subject 
unless he has carried out experiments with his own hands in the laboratory 
and unless he has been evaluated with regard to the skills that he has ac¬ 
quired through a practical examination. 

Practicah : As a matter of fact it is universally agreed that experi¬ 
mental work is vital in the learning of any science and applied science course. 
Theoretical knowledge and experimentation to test and verify its validity are 
complementary to each other. All scientific study is based on observations 
and collection of meaningful data. Skill in observation and the ability to 
interpret the data thus collected as also the ability to design and conduct 
experiments and the development of manipulative skills are some of the 
objectives of training in practical classes. The preparation of scientific and 
Technical reports is still another allied objective of such training. The assess¬ 
ment of practical work therefore needs careful consideration. Since this 
aspect will be taken up elsewhere in greater detail, no more need be said 
here. 

Dissertation : Quite a few universities permit students at the post¬ 
graduate level to write dissenations in lieu of one or two papers. Usually 
this option is allowed to be exercised only in those cases where the student 
already has a good record of work. That is because writing a dissertation is 
useful training for students in the field of research. But before serious re¬ 
search can be undertaken it must be ensured that in terms of his stock of 
knowledge and understanding the student is well-equipped for receiving 
that training. In plain words, it is not the average kind of student who 
should be encouraged to write a dissertation but only those who are dis¬ 
tinctly above average and to that extent can profit from this form of training. 
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Viva-Voce : This does not apply however to viva voce tests which form 
a part of the scheme of examination at the post-graduate level in certain 
universities. Viva-voce tests help to assess a student’s ability to expound 
and support his views and to contradict the opposite point of view. These 
also provide an opportunity of testing a student’s performance in respect of 
a large number of questions so that the range of knowledge tested is not all 
that limited. Indeed from the academic point of view, whether a student 
is poor, average or brilliant, this tool of testing is a perfectly valid and useful 
tool. 

The objection to it, and it is a serious one, comes from another quarter. 
When the number of students examined is large and the time at the disposal 
of the board of examiners is somewhat limited, as is usually the case in regard 
to both these factors, the viva voce test tends to degenerate into no more than 
a ritual. Students appear before the board of examiners, arc asked a few 
questions which neither probe into their stock of knowledge nor draw them 
out in terms of their depth of study and the matter is left at that. In such a 
situation the examiners are inclined to put greater premium on the student’s 
apoearance, manners, verbal facility and such other matters than is academi- 
ca_ly justifiable. A properly conducted viva voce test can be a really effective 
tool of assessment but the practice in mo.st universities goes to show that this 
does not happen. 

There is another important aspect of the matter too. Cases are not 
unknown where the paper-pencil test of students and their viva-voce test 
have no correlation whatsoever with each other. In certain cases this may 
be academically justifiable. But in quite a number of cases, and these are 
more numerous than otherwise, due academic justification does not exist 
and the absence of this co-relationship is owing to factors that do not bear 
too close a scrutiny. In plain words, the existing social realities are not in 
favour of viva voce test being used either extensively or uniformly. 

What is to be done in this situation? To decide that viva-voce tests 
be abolished altogether would be an extreme step. In certain universities 
these tests are being conducted satisfactorily and it would not be fair to object 
to this practice. The seminar therefore felt that viva-voce tests may be orga¬ 
nised only in terms of certain safeguards and in respect of certain examina¬ 
tions. If these precautions are not taken abuses are likely to result which in 
their dimensions may be so serious as to discredit the whole system of viva- 
voce testing. This issue will be taken up again in more specific terms in the 
next chapter which deals with assessment. 

OPEN BOOK TESTS 

In a manner of speaking, open book tests are also one of the per¬ 
formance tests. Unlike most other tests, the student has free access to 
books, documents or any other material which he may require in order 
to be able to solve the questions set to him. The questions do not 
demand rote learning; instead they demand the ability to discriminate and 
judge. What the student therefore does is not to reproduce any material 
which can be conveniently found in a book or a document. In fact he con¬ 
sults various books and documents, establishes for himself the relevance of 
what he finds there to the problem that he is handling and then goes on to 
state his case. The cogency of his statement will depend upon his ability 
to have established the necessary connections and to reconcile conflicting or 
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contradictory facts. That all this is done with clarity and conciseness 
will enhance the quality of his answer. 

As should be apparent, this is a kind of intellectual skill which is dis¬ 
played mainly in those higher ranges of argument and analysis which are not 
within the reach of every student. It is only the distinguished students, 
operating mainly in Helds like law, accountancy, business management, ope¬ 
rational research and such other disciplines that are expected to have this 
kind of skill. 

To jump from this plane of thinking and to go on to suggest that open 
book tests should be permitted to the vast mass of students even at the 
undergraduate level is to completely misunderstand the scope andpurpo.se 
of open book teste. These tests are meant to test the higher abilities and not 
to provide an alibi for poor instruction and lax conduct of examination. 
Over the last few years, as cheating in examination has become more and 
more of an academic and social menace several ingenious people have come 
forward with the suggestion that open book tests would solve the problem. 
For reasons stated above, the suggestion is both puerile and pathetic. To 
believe that a tool of assessment even if misapplied can lead to the right kind 
of assessment is faulty logic. It is important therefore to seek to analyse 
the nature or assessment and under what conditions itought to he conducted. 
This forms the subject matter of the next two chapters. 
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j'our 


Assessment 


The three essential characteristics of a good examination are validity, 
reliability and usability. An examination is valid when it nreasures accu¬ 
rately whatever it is supposed to measure. It is reliable when it measures 
accurately whatever it does measure. (An examination may be measuring 
accurately something else than what we want it to measure. In that case, 
it is reliable but not valid.') An examination is usable when its use is feasible 
in the existing situations. 

THE PUDLIC EXAMINATtoN SY.STEM 

It is evident that the public examination system which is the one with 
which we are most familiar in India & Ceylon does not fully satisfy these 
three essential characteristics. In terms of validity as well as reliability it is 
open to serious objections. The validity of public examinations as predic¬ 
tors of performance in actual life or even in succeeding examinations has 
been found to be low. None of the reliability figures of the public exami¬ 
nations as reported in Indian studies reach even the minimum level accepted 
by experts for the purpose of comparing individual achievements. Most of 
these criticisms have been documented by a number of studies undertaken 
by various people. It is not necessary at this stage to go into them in any 
detail. Those who arc curious can refer to the extensive literature available 
on this subject. 

Its usability however is not as much open to objection, provided the 
appalling failure rate is not regarded as an inseparable part of the system. 
Nor should the frequent student trouble be regarded as a part of it. Strikes 
and disruptions of examination schedules have become a common pheno¬ 
menon but it Would be too much to say that these are entirely traceable to 
the system of public examinations. For more than a century this is the 
system that people have known. Indeed so firmly entrenched has this sys- 



tem become in the public imagination that I he vast majority are unable to 
conceive of anything different. 

During the last couple of decades those who wanted to escape the 
tyranny of this system advocated extensive use of the internal assessment 
system. While more would be said about this system a little later, it is 
enough to say here that this system of assessment even when combined with 
the public examination system has failed to win widespread acceptance or 
inspire general confidence, in the event, the public examination system 
has got further strengthened. To seek to change it does not seem to be a 
very feasible proposition therefore. 

Two factors, one historical and the other sociological, have contributed 
substantially to the strengthening of this system. For historical reasons 
higher education in India has expanded largely through increase in the number 
of colleges. As a matter of fact, the colleges were established first and 
the university departments came much later. Right from the beginning 
therefore, the primary job of the university cam.e to be conducting exami¬ 
nations for students enrolled in different colleges. And precisely because 
they were in different institutions, even though the syllabus followed was the 
same, there were variations in the quality of teaching. A public examina¬ 
tion provided a common scale to measure the performance of individuals in 
these different colleges. In one sense, this prevented standards from going 
down below a certain level. In another sense, it also prevented standards 
from going up beyond a certain level. This is a limitation which is built 
into the system. At the same time there is no getting away from the fact 
that today there is virtually no other index available of a student's compe¬ 
tence than his marks in the public examination. Why this should be so can 
be understood with particular reference to the sociological reasons, ana¬ 
lysed below, for the dominance of this system of examination. 

The public examination ensures anonymity. This means that, barring 
a few lapses here and there, the identity of the student remains un¬ 
known to the examiner. In this situation ilie student neither gets the advan¬ 
tage of being known to the examiner nor the disadvantage of being penalised 
because of something unacceptable in his person, caste, community and such 
other factors. It is this dependability of the public cxam.ination which has 
won for itself a position of pre-eminence. Attempts to change it invariabh 
run into difficulties because the moment the identity of the student or of the 
examiner is known, the objectivity of assessment appears to get vitiated. 
This has become so much a part of the Indian educational scene today that 
despite the loW levels of validity and reliability of the public examination and 
its marginal strength in terms of usability the system has become firmly 
rooted in our country. 

The general consensus of opinion at the seminar therefore was that with¬ 
out decrying other methods of assessment, it should be recognised that the 
system of public examination has come to stay and that whatever improve¬ 
ments and innovations are to be carried out the attempt should be to do so 
within the framework of this system. More specifically, the public exami¬ 
nations should be enabled to become more comprehensive so that they 
cover almost all important outcomes of education and, more im.portant than 
anything else, measure learning rather than cramming. This can be done 
by (a) re-designing question papers, (fi) changing the techniques and tools of 
examinations and wherever feasible, (r) supplementing the system v/ith other 
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systems and modes of testing—say the semester system and internal assess¬ 
ment. 

the semester system 

Ideally a student should be judged on the basis of his performance 
throughout the entire period of his study. Amongst otherthings, this will 
ensure that a student is not judged by his performance on an inadeejuate 
sample of questions at a particular moment of time. Rather he should be 
judged on the basis of a large number of questions spread over a certain 
span of time so that the mode of assessment does not work to his disadvan¬ 
tage. To remedy these limitations to some extent most universities in other 
countries use the semester system. 

The essence of the semester system is that the academic year is divided 
into two or three sessions, each one of which is called a semester. (The 
basic ditference between the words term and semester lies in this that at the 
end of a semester an examination is held while the word term simply con¬ 
notes a division of time. The word semester also indicates that a certain 
unit of course work has been completed.) The syllabus lays down the de¬ 
tails of work for each semester, the permissible combination of courses and 
the number of courses required to be passed to get a degree. Each course is 
a self-contained unit. After each semester there is an examination. A 
student who fails in a course is required to pass only that course and not all 
the courses studied in that particular semester. For the benefit of those 
students who fail in a course or want to study additional courses, instruction 
is arranged even during vacations. In certain universities the summer vaca¬ 
tion is described as the summer term, the idea being that academic Work 
goes on throughout the calender year. Those who fail to keep up with the 
pace of work in the course of the academic year or wish to cover the course 
in a .'horter span of time than the rest also attend the summer term. 

The two basic advantages of this system are that the work-load of the 
student is even throughout the year and, secondly, practically no one fails. 
This is not to suggest that everyone who starts a course is passed as a result 
of the test. It only means that failure in one course does not put the student 
back by six months or a year. If a student has failed he sits for that exami¬ 
nation at the end of the next semester or the one after that. The incentive 
to work harder therefore is built into the system and there is a disincentive 
against becoming slack, irregular or negligent. Sometimes it may mean 
that a student does not get his degree in the minimum period required but on 
the whole the loss of time is so nominal that once a choice has been given 
very few students prefer the existing system to the semester system. 

Jn order to ensure the successful working of the semester system certain 
problems have to be anticipated and solutions sought in advance. For 
instance, teaching has to begin as soon as the semester starts. To lose even 
a few days of teaching can hurt a student. Anyone who joins late will 
hardly have enough time to prepare for the course. Secondly, the splitting 
up of courses into several units may lead to compartmentalisation of know¬ 
ledge. Care has to be taken therefore at the planning stage. Nor can plan¬ 
ning be carried out once for all. Every new experience requires to be assimi¬ 
lated by the teachers so that courses once designed do not become tools of 
tyranny which can happen if academic flexibility has not gone into the design¬ 
ing of courses. Yet another minor problem can be the preparation of a 
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suitable time-table so as to provide for the teaching of the various combina¬ 
tions of courses. But this is a minor difficulty and can always be overcome. 

Outside the IITs and certain specialised instilulcs only a few universities 
are using the semester system. The experience of these universities is not 
exactly the same however. In some universities the system has given en¬ 
couraging results. In others there are problems and tensions to which 
answ'ers have not been found in all cases yet. Most of these problems arise 
from the fact that not only are students required to work harder and through¬ 
out the year, the teachers too are required to keep up the same pace of work. 
To the extent that this happens the experience of the introduction of the 
semester system is altogether favourable. 

The seminar felt that the experience of these various universities 
needs to be analysed in some detail. As a part of the follow-up of this 
seminar, the Inter-University Board might set up a small committee to under¬ 
take such a study. Meanwhile there is enough evidence to show that this 
system needs to be introduced on a much more extensive scale than has 
happened so far. 

INTEJINAL ASSESSMENT 

In contradistinction to the system of public examination, the system 
of internal assessment of students by their teachers was introduced at n 
number of universities in recent years. The American influence in this 
respect was unmistakeahly strong. The number of those who have attend¬ 
ed American universities for their advanced work or have accepted teaching 
positions there has been on the increase of late. The number of American 
educators who have visited India in the last few decades has also risen steeply. 
As a result of this growing two-way traffic and increasing concern with re¬ 
gard to the validity and reliability of examinations in India, the inference 
drawn by most people concerned with this problem was that the tyranny of 
the public examination should be minimised and greater weightage ought 
to be given to assessment of students by their teachers. After all, what 
could be more natural and more academically sound than this that those 
who teach also examine. 

The gap in theory and practice however is startlingly wide. Several 
universities embarked on this new scheme with fervour and enthusiasm. 
Except for a handful the rest have had to temper their enthusiasm with 
bitter experience. This new system has succeeded only in those places 
where the student-teacher ratio is favourable, the quality-of students as well 
as teachers is distinctly above average and the university authorities function¬ 
ing through the academic council or some equivalent agency have been able 
to keep a close and vigilant watch on the functioning of the system. 

Wherever this kind of vigilance has not been exercised the results have 
been unsatisfactory. In certain cases students have mounted pressure and 
used other questionable means to influence their teachers. In a number 
of cases, teachers on their part have shown neither stamina nor the requited 
degree of integrity and have succumbed to pressures. In certain other 
cases teachers have used this power over students in an arbitrary, wilful and 
oppressive manner. This has been done in two ways. Sometimes those 
who deserved better had been marked down. In other cases, certain unde¬ 
serving students have had their marks inflated to such an extent that others 
who had been assessed fairly, ultimately came to develop a grievance. The 
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upshot of all this has been loss of faith in the objectivity of the teachers and, 
occasionally, noisy and prolonged -Drotests by students. A number of uni¬ 
versities have had to hastily revise tiis system of assessment and revert to the 
time-honoured method of public examination which while being notoriously 
unreliable and open to several similar objections at least had the merit of 
being non-subjective and hence universally acceptable. 

It needs to be stated at this stage that despite all these negative features 
internal assessment has been more successful at the post-graduate level than 
at the under-graduate level. Also it has been more successful in unitary 
and residential universities than in affiliating universities. For one thing 
the number of students at the post-graduate level is smaller and tha student- 
teacher ratio is normally satisfactory. For another the quality of students 
as well as teachers at that level is usually better than at the under-graduate 
level. Even these two favourable factors however failed to ensure unifor¬ 
mity of assessment in those cases where these post-graduate students were 
divided over several colleges. As a matter of fact the genera! practice ha.i 
been that the more conscientious the college, the more strict it is in its assess¬ 
ment of students. Consequently the better students came to be judged, re¬ 
latively speaking, more strictly than the rest who were not so academically 
good. This led to all kinds of imbalances and frictions and the system 
therefore failed to function effectively. What could not function effectively 
at the post-graduate level could hardly function at the under-graduate level. 
So as stated above, the general experience has been that this system while 
completely admirable in every respect was beset with all kinds of problems. 

Before concluding its deliberations, the seminar resolved as follows: 

“As things have evolved the system of public examinations has come to 
stay. Most recent attempts at changing the system have been concerned with 
introducing internal assessment progressively. In principle, the seminar is 
in favour of interna] assessment. Its large scale introduction however would 
be possible only after adequate preparations are made and necessary admi¬ 
nistrative safeguards are provided. The seminar therefore affirms that most 
of the innovations that can be introduced have to be either within the frame¬ 
work of the public examinations system or through a judicious combination 
of this system with the internal assessment system." 

The foregoing discussion suggests that while internal assessment will 
be used sparingly and by those institutions which can take all appropriate 
precautions against its misuse the vast majority of students will continue to 
be assessed by the public examination system. At one level the evils of this 
system can be moderated by dividing the academic year into two or tliree 
semesters and adjusting the process of instruction accordingly. At another 
level, it is also important to improve and refine some of the techniques of 
public examinations where the numbers involved in any case are fairly large. 
Specifically, attention needs to be given to issues like scoring, scaling, mode¬ 
ration of results, grading, and such other mailers. 

SCORING 

Scoring' means the process of allotting marks to students' perfor- 
inaiice in examinations. This process can be categorised under two broad 
headings (a) where sivileiils arc required to compose their response.', and {b) 
where they are required to select one of the responses already given in the 
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question-paper. The essay-type questions, structured questions and short- 
answer questions belong to the first category and the objective-type questions 
to the second category. Because of their very nature, the first type of ques¬ 
tions suffer from an excessive element of subjectivity. However the magni¬ 
tude of the subjectivity can be significantly reduced by improving scoring 
techniques. The following suggestions made by the seminar are directed 
towards this end. 

(a) In addition to setting the question-paper, the paper-setter should be 
required to give detailed guidelines for scoring answers. In case 
of numerical problems detailed solutions to the problems and scores 
to be given to each solution need to be indicated. 

{b) To refine the scoring scheme and to make it more comprehensive 
the various examiners ought to be brought together alongwith 
the paper-setter or head-examiner as the case might be. At such a 
meeting, apart from general discussion, each of the examiners would 
be asked to examine a number of the same scripts independently. 
After that the ensuing discussion would naturally be specific and 
wherever there are differences of approach and opinion these can 
be settled. 

ff) The job of the head-examiner after such a meeting would be to 
ensure that the scoring scheme, described as above, is strictly ad¬ 
hered to by the examiners working under him. if the examiners 
can be brought together to work at one place under the supervision 
of the head-examiner, that would be excellent. This has been done 
at a number of places and need not be regarded as a counsel of 
perfection. But if this cannot be done the head-examiner should be 
required to review at least 5°„ of the scripts scored by every exami¬ 
ner. If the number of examiners is large, additional or deputy 
head-examiners can alsg be appointed. 

(rf) To ensure that the scoring scheme is followed faithfully it is neces¬ 
sary to place a limit on the number of scripts to be examined by each 
examiner. Something like 300 scripts in 10 days at the under-gra¬ 
duate level seems appropriate. At the post-graduate level however 
250 scripts would be more reasonable. This recommendation as¬ 
sumes that the examiner is not attending to his teaching and other 
responsibilities during those days. 

(e) In order to be able to enforce this limit the university ollice would 
have to do advance planning. As soon as the list of candidates 
appearing for a particular examination is finalised, the number 
of examiners required can be worked out accordingly. 

(f) Properly speaking, each script should be examined independently 
by two competent examiners. This has not been found very fea¬ 
sible however at the under-graduate level. At the post-graduate 
level this has been done successfully by a number of universities 
and the system is worthy of serious consideration. 

(g) When two independent examiners award two different sets of 
marks to the same script, the question arises how this difference 
is to be resolved. This is a matter that requires further research 
and the seminar was unable to make a definite recommendation. 
Perhaps this could be one of the tasks that the proposed Central 
Unit could take up on a priority basis. 
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None of these suggestions is completely novel in so far as each one of 
them is being followed by some university or the other. Several more 
can also be thought of to cope with the various situations as these arise. 
It must be lecogm'sed however that even when all precautions have been 
taken the subjective element would not have been completely eliminated. 
This is inherent in the assessment of essay-type questions. Indeed as long 
as our question papers continue to be traditional in their structure and em¬ 
phasis, ih: evils of ihe examination system can only be minimised, 
not completely eliminated. 

CHECKING OF MARKS 

When the number of scripts handled runs into hundreds of thousands, 
as happens in respect of a large number of universities, exceptionally stringent 
precautions have to be taken against laxity of functioning. One of these 
precautions is to ensure the thorough checking of marks in respect of each 
script and each question. The checker’s job should be to see that no ques¬ 
tion has been marked twice, no extra question has been marked, no question 
has been given more marks than allotted to it and that there is no mistake 
in totalling- Even blank pages have to be checked so that nothing gets 
left out and no irregularity remains undetected. Mistakes, if detected, 
must be brought to the notice of a scrutiny officer (or whatever be his design¬ 
ation) so that he can check the script over again. Where both are convinced 
of the mistake/s, necessary correction/s should be made under the signa¬ 
ture of the checker and counter-signature of the scrutiny officer. Where a 
question has been left un-marked, the script should be returned to the same 
examiner, or the head-examiner. Necessary corrections in the marks-sheet 
have also to be made before being passed on to the tabulators. 

A checker may turn over something like 300 scripts a day. The total 
checked however should not exceed 5000 scripts, lest the job should get 
done casually. The ratio between the number of checkers and the scrutiny 
officer may be 10 ; 1. It is also important to lay down the qualifications of 
checkers as well as scrutiny officers. 

RE-SCORING OF SCRIPTS 

Sometimes re-scoring of scripts might prove that the examiner has been 
grossly negligent. If this fact is conclusively proved, there is a good case for 
debarring such a person from being engag.:d as an examiner in future years. 
Quite a few universities have provisions to this effect in their rules but these 
are seldom invoked. Not to invoke them is to attach more importance to 
the prestige and welfare of the examiner than that of the examinee. In terms 
of priorities it is the wrong order to follow. Even as it is, the traditional 
examination system is, so to speak, loaded against the student. Not to be 
able to ensure that the examiner does his job conscientiously is to load it 
even more heavily against him. 

To deal with minor mistakes which can be detected by checkers and 
scrutiny officers is, comparatively speaking, a simple matter. Most univer¬ 
sities have a classified list of the possible slips that can be made by examiners 
and the penalties that go with each one of those slips. Depending upon the 
number of mistakes made the amount thus computed can be deducted from 
the remuneration. 
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APPOINTMENT OF EXAMINEIlS 

This whole discussion raises the question of how examiners are appoint¬ 
ed and what should be their qualifications. Over the years universities have 
evolved procedures in this regard and it does not seem necessary to refer to 
them in any detail. The following points may however be noted : 

(a) In principle whoever is fit to teach is also fit to examine. 

(h) In appointing examiners therefore, undue importance need not be 
attached to seniority as a teacher. This approach gives rise to a 
kind of spoils system. To w'eaken it, a matter of high priority, 
it is necessary to have as much rotation amongst examiners as is 
practicable. 

(f) An important qualification to be looked for amongst examiners 
should be to what extent they are careful and conscientious. This 
is a matter to which universities may pay more attention. 

(il) Ensuring secrecy in respect of those appointed is imperative. The 
system evolved for appointing examiners in most universities often 
conflicts with this requirement. When the appointment of exa¬ 
miners is the exclusive preserve of a small coterie of people, as has 
been happening in quite a few universities, there is usually a de¬ 
mand to make the whole thing open and democratic. This usually 
means that secrecy is sacrifice in the interest of justice. What is 
required is a system whereby bothjustice and secrecy are ensured, 
f c) In quite a few universities recommendations are made by the boards 
of studies but the final selection is made by another agency. Some¬ 
times it is the vice-chancellor himself and sometimes it is a com¬ 
mittee. Whichever method is adopted the important thing, let it 
be repeated, is to ensure that the same set of people are not ap¬ 
pointed year after year and that the identity of examiners does 
not get icnow'n except fo those concerned with the examination 
work. 

(f) The proporiion of internal and external examiners has also been 
a matter of debate in quite a few places. Most universities like 
to observe the 50 : 50 proportion. On the whole this is a salu¬ 
tary practice. At the same time instances are not unknown where a 
greater proportion of internal examiners have been introduced 
without hurting the standards or comproinisfng the integrity of 
work. Perhaps a distinction ought to be made in terms of princi¬ 
ples between the under-graduate and the post-graduate level. 

OBJECTIVE TESTS 

What has been said above applies to that kind of testing where students 
are required to compose their responses. There is also another kind of 
testing where students are required to select one of the responses already 
given in the question paper. These tests are popularly known as objective 
tests. For every question a few answers are given in the question-paper and 
students are required to select the best answer. It is not necessary to go 
into further details at this stage. These can be found elsewhere in this book. 
It is enough to say here that this mode of testing has been found useful in 
those countries where, (a) machine scoring is preferred, (ft) emphasis is placed 
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on testing a student in terms of his entire course and not selected bits, and, 
(f) working at top speed (that is doing a given span of work within the allot¬ 
ted time) is regarded as an important educational objective. 

In terms of chronology, objective tests are essentially a twentieth cen¬ 
tury phenomenon. In recent decades the problems of testing have received 
considerable attention. Beginning in a tentative way, these tests have been 
developed and refined to such a point that in certain countries these are used 
for the asessment of some of the higher skills as well. In any event, it is 
recognised that objective tests are not an exact substitute for the essay-type 
testing which has been the traditional mode of assessment over the centuries 
but they have immense pedagogic value. To remain wedded to the tradi¬ 
tional system is to deliberately ignore the advances made in this field during 
the last half a century. To rely e.xclusively on them however is to become a 
cLiltist. It is for this reason that the seminar recammended that objective 
questions should be used in judicious combination with the other types 
of questions. There arc certain types of abilities which can be tested quite 
elTcctively by these objective tests. To this extent, objective tests must be 
u.sod. The dominance of the essay-type testing is so strong in India as well 
as in Ceylon that a planned and gradual shift away from the traditional sys¬ 
tem would be a step in the right direction. 

Since this system is not known widely in the country, steps have to be 
taken to familiarise academics with the various difficulties that have to be 
mastered before objective test.s can be used on any significant scale. These 
dillicuJties are discus.sed elsewhere in the book and it does not seem necessary 
to refer to them in detail here. 

I’KACTICALS 

There arc certain eJiicaiioiul outcomes which cannot be examined 
by papcr-pcncil te.q.s. c.ir. handling of instruments, ability to set up and 
conduct experiments, etc. For examining such outcomes, practical exami¬ 
nations are indi-spen^able. There are difficulties however which have to be 
overcome if assessment in respect of practical examinations is to be a.reliable 
guide to the abilities of a student. For instance, the clement of subjectivity 
on the part of the examiner can he quite pronounced in the case of a practical 
examination. Then there arc external factors, such as, his physical, mental 
and emotional condition, th.e condition of the apparatus gisen to him. the 
difficulties of the individual task assigned, the atmosphere of goodwill and 
cooperation the examiner is able to create and other facilities like light, 
ventilation, temperature of the room, etc., which influence a student's per¬ 
formance. Not only that, there is no record left for the re-scoring of a stu¬ 
dent’s performance. Owing to all these reasons, practical examinations 
may not attain a high degree of reliability. Yet, if we do not have practical 
examinations at all for fear of low reliability, students may not develop 
any skill worth the name in the use of instruments and other manipulative 
skills, and these are crucial in scientific training. 

Despite what has been said above, it is possible to improve the reliability 
of practical examinations if the tasks set to all the students are equally diffi¬ 
cult and, no less important, are carefully planned by the examiner much ahead 
of the examination. The scoring scheme can be drawn up in such a manner 
that marks are allotted for each type of abilities to be tested. In case of 
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any careless mistakes penalties by way of deduction of marks can be imposed. 

Though opinion was somewhat divided in the matter, the majority 
of those present were firmly of the view that results in practicals should 
not be based on a single examination at the end of the course. Instead 
there should be more than one examination during the course of study. 
In this regard the following suggestions were made : 

(a) External examiners may conduct practical examinations at least 
twice a year. 

(b) There might be continuous internal assessment of a student's 
performance throughout the year. 

(c) Equal weight be assigned to the assessment made by the external 
examiners and the internal examiners. 

Which of these procedures may be adopted and in which combination was 
left to the universities to decide. 

In almost all universities there is a practice according to which students 
maintain note-books of practicals done by them. The record should be, 
it may be mentioned in passing, in the form of a project report wherein he 
should mention the difficulties in manipulation, details of observations 
made, tabulation and correlation of data, standard error of measurements, 
etc. While awarding scores on practicals, examiners take into account the 
record of work done by a student in the course of the year. As the range of 
experiments prescribed for the course hardly vary from year to year, some 
students simply copy down what their predecessors had done in the preced¬ 
ing years. The seminar therefore recommended that whichever of the 
methods proposed above is adopted it is important to ensure that students 
do not get any credit for the record of their practical experiments in case 
the examiner suspects that what ho secs in front of himself is only a repeti¬ 
tion of work done by earlier batches of students. 

VIVA-VOCE 

The desirability and olherwi.se of viva-rocc tc.st.s has already been dis¬ 
cussed in the preceding chapter. Should a uni\'cr5ity ultimately decide to 
use this mode of assessment, the following precautions must invariably be 
observed : 

(fl) It was reported to the seminar that in certain universities v/ro- 
yoce examinations are held before the written examination. This 
is not correct. Viva-voce examinations should follow the written 
examination and not precede it. Indeed if more than one exami¬ 
nation is held during the course then viva-voce examination should 
be held after each examination. 

(b) Properly speaking, such an examination should be held in respect 
of each paper. If, as a result of certain practical difficulties, this 
cannot be done, the viva-voce examination should be based on all 
the written papers taken as a unit. 

(c) The viva-voce examination should be conducted by a board of three 
examiners, at least one of whom should be internal and one exter¬ 
nal. 

(d) Each student should be given at least 15 minutes. 

(e) Marks secured in viva-voce examination have to be combined with 
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the marks secured in the written examination. But two precau¬ 
tions must be tajcen. One, that every student should secure a mini¬ 
mum percentage of marks in each category. Two, that in the 
marks-sheet issued marks in respect of both are shown separately. 

(/) In order to be meaningful, weightage for the yim-wce examination 
should not be less than 10% of the total marks. The upper ceiling 
in this regard need not be unduly high either. 

(g) V/va-voce should form an essential part of practical examinations 
at all levels. 

Opinion with regard to the advisability of using this mode of assess¬ 
ment was sharply divided. Apprehensions regarding its misuse were strongly 
articulated. The seminar therefore recommended its use only at the post¬ 
graduate level and that too after due safeguards against misuse had been 
taken. 

SCALl.NG 

The procedure of converting different scales to a common scale is term¬ 
ed “scaling”. 

Two members cannot be validly added unless both represent the same 
scale of measurement. For instance, no direct addition of metres and yards 
can be validly made. For this purpose we have to convert the two scales- 
metres and yards—to a common scale. We could do it by 
converting metre.'; into yards or yards into metres or both to a common scale. 
This is a fundamental principle of arithmetic. Everyone uses it in day to 
day life. Yet, strangely enough, in dealing with examination marks this 
simple principle is often completely ignored. 

It is an e.stablished fact that no two examiners have the same scale of 
marking. Hence direct comparison between the marks awarded by two 
examiners cannot be validly made. The need for scaling arises when direct 
comparison is to be made between marks given by different examiners in 
respect of different papers and different institutions. Detailed discussion 
on the details of methods of scaling is given in Part TI of this book but a 
few points may be referred to here as well. 

For instance, a few examining bodies directly add objective-test scores 
to essay-test scores. This practice is objectionable for two reasons. One, 
it gives objective test performance more weightage than is justiflabic. To 
illustrate, suppose a hundred mark test of three hours is divided into two 
equal parts, one part having essay-type questions and the other having objec¬ 
tive-type questions. The essay-type questions will carry 50 marks since 
100 has to be divided by two. The objective questions, on the other hand, 
would in this manner carry 150 marks as the objective questions to be done 
in 11 hours may include 150 items. If objective-test scores are directly added 
to the essay-test scores, evidently the objective test would carry three times 
as much weight as the essay test ofthesamedurationoftime. Two, unsealed 
objective-test scores are likely to over-estimate or under estimate students’ 
achievements depending on item difficulties. There are other considerations 
also that have to be taken into account in interpreting objective-test scores. 
All these considerations cannot be discussed here due to paucity of space. 

It seems right to insist therefore that being a technical matter objective 
testing should be introduced in examinations only after proper training of 
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persons Involved in the construction, administration, scoring and interpre¬ 
tation of objective tests.* 

The seminar noted with concern that while the need for scaling exami¬ 
nation marks is obviously so great, hardly a few universities use this system. 
The only university, according to information available, which uses this 
system in respect of all its major examinations is Gauhati. Elsewhere it is 
rarely if at all used and that too in respect of certain examinations. In the 
traditional essay tests there are differences in marking standards which vary 
from examiner to examiner, from paper to paper and from institution to 
institution. In the case of those institutions which give some weightage to 
internal assessment the variation is likely to be even steeper. In consequence, 
a student's results may be based more on the marking standard he happens 
to get rather than his intrinsic merit. All this needs to be straightened out 
and the only way of doing it is to adopt scaling as one of the essential prin¬ 
ciples of assessment. 

There are several methods of scaling. An appropriate method would 
take into account both mean and standard deviation. It was left to the 
universities to decide which particular method suited them. 

When marks of different examiners are to be scaled, one of the following 
conditions should be satisfied : 

(1) Each examiner gets an equivalent set of scripts. 

(2) There is an accurate estimate of the dilTerenccs amongst the batches 
examined by different examiners. 

To satisfy the first condition, one method would be to distribute scripts on a 
random basis. This can be done by allotting roll numbers from a table of 
random numbers. Another could be the distribution of roll numbers in the 
manner as is done in Gauhati University (for details please see V. S. 
Misra’s paper on “Scaling of Examination Marks"). 

In case it is feasible to distribute scripts on a random basis, some method 
has to be found to satisfy the second condition. One such method could be 
the provision of a link test (details of its construction and use can be found in 
the two books by Dorothy C. Adkins and A. E, Traxler referred to above) 
which would be an objective achievement test. Another could he the provi¬ 
sion of the same scripts, about a dozen in number and representing various 
levels of abilities, to be independently examined by all the examiners. Which 
method is followed was left to the universities. 

TRAINING OF RANDOMISERS AND SCALERS 

As .should be evident, randomisation of scripts and .scaling of marks 
are technical matters. Hence those engaged in these tasks would require to 
be trained. Perhaps the UGC could undertake this job and other related 
jobs which require training in the various technical matters connected with 


‘For further di':cuSjion on scaling in respect of objective lest scores, the followint; nia y 
be consulted: Adkins, Dorothy C. ConstrucHon anU Analysis of Achievement Tests, 
Washington D.C., United States Civil Service Commission, 1947, pp. 104-202. 

Traxler A.E. “Administration and Scoring of the Objective Tests" in E.F. Lindqutsl 
fEd.), Educational Measurements, Washington D.C.,American Council on Education, 
1951 pp. 329-416. 
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examination reform. Since it may not be possible for a large number of 
people to receive training it may also be useful to prepare a manual des¬ 
cribing these technical matters in non-technical language. This manual 
should explain in detail various procedures, educational and statistical, 
that would improve the reliability and validity of examinations. This 
manual should be widely circulated and made available to universities, col¬ 
leges and all others interested in this work. 

moderation of results 

After results are tabulated it is found that some students do not pass 
by a narrow margin. In view of the unreliability of examinations such .stu¬ 
dents are allowed to pass by awarding them grace marks. The very des¬ 
cription ‘grace marks’ sounds as if marks are being given to students out of a 
feeling of charity. This is resented by some people. Another reaction is to 
regard the whole thing as an under-the-counter device to help those who do 
not deserve to be helped. This feeling of revulsion is sometimes expressed 
by the use of the term ‘disgrace marks’. 

The seminar therefore recommended that the use of the term grace 
marks should be given up. Instead these marks should be described as 
msderatiofi marks. Technically too, that would be a correct descriplion. 
To enable those students Who are failing by a narrow margin to pa.ss is not 
an act of charity. It is an acknowledgement of the unreliability of exami¬ 
nations. 

It is easy to expound this principle but difficult to implement it in con¬ 
crete situations. That is bccauscwhat constitutes a border-line caseissome- 
times a matter of definition and sometintes a matter of judgement. If it 
were all to be laid down inadvance (oneproposal which received strong sup¬ 
port was that the maximum moderation permissible should be one per cent 
of the total marks in that particular course), the whole thing may become 
mechanical. If it were left to the discretion of a committee, however care¬ 
fully constituted, arbitrariness could not be ruled out. A point of view 
expressed forcefully was that examination marks are sacrosanct and what¬ 
ever decisions are taken should be based on certain sound and weW-defined 
principles rather than on the subjective judgement of a committee. Clearly, 
there is hardly any meeting ground between these two points of view. Ins¬ 
tances are not unknown where the application of a mechanical formula has 
failed to meet the needs of the situation. At the same lime in certain cases 
deci.sions taken have been of such ascandaloiis character that enquiries have 
hadto be instituted. There was not enough time at the disposal ofthesem.i- 
nar to evolve a set of foolproof recommendations. The matters with re- 
giirdto which agreement could be reached were as follows : 

(«) Results of every examination must be moderated as an additional 
check against the vagaries of marking. 

(/>) As a matter of policy, there should be clearly formulated principles 
of moderation (relying largely on the basis of standard error of 
measurement or other appropriate statistical methods) which are 
appliedconsistently every year and in respect of each examination. 

(c) Where these general principles become inapplicable andthemode- 
ralion committee is convinced that some thing more is required, 
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the matter may be referred to the vice-chancellor or anyone desi¬ 
gnated byhimtodeal with such cases. One method could betoget 
the scripts of such student/s re-examined, the reference point being 
whether the candidate deseiA^es a pass or not. Still another 
method could be to give a parallel test (a parallel test means a test 
built by the same procedures to the same specifications and 
examined by equally competent examiners) only in the papers in 
which the candidate has failed. 

(d) Whatever method be used, it should be applicable only to pass/ 
fail, border-line cases and not to those who are likely to get a higher 
division in consequence of the re-consideration. 

(e) It is more desirable to have a moderation committee com.mon for 
all the examinations of the university rather than for each subject 
or each examination. In certain universities there exists a body 
called the Examination Board. The powers of this board are sel¬ 
dom well-defined with the result that its functioning is neither 
effective nor consistent. The task of ensuring that examination 
work goes on smoothly can be handled by the vice-chancellor as 
advised by the Examination Board or by the executive and the aca¬ 
demic councils. The responsibility of acting as a moderation 
committee is the heart of the matter however and it would be more 
desirable to describe the committee as the moderation committee. 

(/) Whatever decisions are taken should be reviewed by the examination 
research unit which, as recommended already, should be estab¬ 
lished in each university. 

(g) This problem requires further investigation and should be explored 
in greater depth at some subsequent seminar. 

GRADING 

In order to assess the quality of a student's performance the system of 
grading has to be precise as well as scientific. The one in force in most uni¬ 
versities today does not conform to these requirements in any significant 
degree. Some of the salient points in regard to this issue are discussed 
below. 

The system of jading in our country is predominantly numerical 
in respect of the various categories—^pass, second division, first division, 
distinction (wherever it exists). It is not unusual to find a student who has 
failed by a few marks or has failed to secure second or first division by a 
narrow margin. While moderation of results can take care of the former of 
these two situations, the system docs not work consistently or effectively. 
A further corollary of this system is that if a candidate gets, for instance 2 or 
3 marks more than another candidate in the aggregate which may be out of 
600/800/1000 marks, he is preferred to the other one who is trailing behind 
him. This is not exactly scientific. 

The practice in most other countries is difierent. They classify students 
into various categories. Since categories vary from country to country and 
from system to system, it is not possible to enumerate them with any pre¬ 
cision. The point to note is that if a student, for instance, gets A-I-, his 
capability has been assessed within a certain range. Numerical marking is 
absolute. 65 marks means 65 marks. It neither means 64 nor 66. Whereas 
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A + might mean anything from 60 to 70 or 65 to 75 or 70 to 75. The 
variation given here need not cause any confusion because the categorisation 
differs from system to system. 

Another important aspect of it also needs to be referred to. It is widely 
known that a student in Mathematics or Physics can easily score 80 or 90 
marks whereas the same does not apply to a student in History or Socio¬ 
logy. Indeed a first-rate student in the latter two subjects may score no 
more than 60 or 70 marks. There is no disagreement with regard to their 
respective qualities of mind but their numerial scores are different. This 
is bound to be so as long as the numerical system is followed. To imagine 
however that the numerical system as prevalent today will be given up is a 
vain hope. If at all it is given up, it will be at a much later stage when some 
of the more urgent reforms have been already carried out. So no more need 
be said about it at this stage. 

There is one thing however that can be done and is in the process of 
being done. This refers to the absolute versus relative system of marking. 
In the absolute system of marking, a student’s achievement is measured 
on a continuum. This is usually expressed in terms of percentage. The 
idea is that one who has learnt everything that he is required to learn as 
prescribed in the course would be given 100 and one who has learnt nothing 
would be given 0. Others would be given marks betwen 0 and 100, depend¬ 
ing upon their respective levels of learning. The advantage of the absolute 
system is that it indicates directly to what extent a student has learnt 
the prescribed course. This information is indispensable for selecting 
students where a minimum level of achievement is an absolute must. 
The limitations of this system must also be acknowledged. It does not, for 
instance, tell anything about the relative performance of the students. Em¬ 
pirical evidence suggests that in absolute terms 5 to 7 levels of ability can be 
differentiated by human judgement. Thus the grading of students on an 
absolute system of 100 units is not very practicable. 

To overcome these and other limitations suggestions have been made 
to use the relative system of marking. This system differentiates students 
on the basis of their relative performance. Differentiation is made in terms 
of percentile ranks or categories. In this connection attention of the semi¬ 
nar was drawn to the following observation of the Education Commission: 

“We recommend that the grading or classification of examination re¬ 
sults is almost invariably done on an absolute rather than on a relative 
basis. In our present system of examination, 80% marks in Mathe¬ 
matics does not convey the same meaning as say 80% marks in History 
or English. Again an 80 % marks on one year does not mean the same 
thing as 80% in another year because examiners may be different and there 
may be many other variations from year to year. A system of grading 
must be such as to bring out whether a student belongs, say to the top 
20% of his class or to the bottom 20”„. It is strongly recommended 
that even if the present system of examinations and classifying the re¬ 
sults is continued, it should be supplemented by giving, in the same 
certificate, the relative grading of the student, say on a five point-scale. 
Grade ‘A’ would mean that the student is in the top 20"„ of those who 
have been successful at the examination.” 

To sum up, the seminar felt that there is not much meaning in small 
differences of the numerical scores. What is more helpful and relevant is to 
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indicate a student's rank in the group. Tt is necessary to report the per¬ 
centile ranks of the students in each paper in addition to their scores which, 
as recommended above, have to be duly scaled. To improve the effective¬ 
ness of the results as an indicator of a student's merit, the percentile grades 
of the c.indidates in different papers ought to be taken into account while 
deciding his final grade. 

It was noted in this connection that the recommendation of the Edu¬ 
cation Commission, as given above, ha.s been endorsed both by the Inter- 
University Board and the University Grants Commission and that steps 
are being taken to inform the Union Public Service Commission and other 
State Service Commissions, as also the Reserve Bank of India to accept this 
new basis of awarding grades once the universities are able to adopt the 
new system. 

RE-APPEARING IN THE E.VAMINATION 

Failed students are allowed to rc-appear in the examination within a 
certain number of years. The rules in this regard vary from university to 
university. Of late those studentswho hadpas.sed out and wished to improve 
their division are also being allowed to re-appear. In the opinion of 
the seminar, there should be some limit to the number of chances that can 
be given to a student for improving his class. Not more than three chances 
in five years is a reasonable limit at the post-graduate level. The nece.ssily 
for such a provision at the under-graduate Icsel does not seem to be urgent. 
Should there be a demand for it, what is applicable at the post-graduate level 
can also be made applicable at the under-graduate level. 
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:^ive 


Concuct o: Examination 


HAVING EXAMINED THE principles and procedures of assessment it is time to 
turn to liow examinations are arranged and conducted by universities. Where 
the university is unitary and residential the problems are, comparatively 
spealcing, very few. The numbers involved are not large and the student- 
teacher ratio is generally good so that there are not many problems. In the 
case of universities which have a large number of affiliated colleges and centres 
of c.xamination have to be located over a wide geographical area, the prob¬ 
lems are immense and demand considerable planning and coordination. In 
particular, care has to be taken to see that there arc no breakdowns in res¬ 
pect of coordination and the required facilities and materials are made 
available to candidates under conditions that are deem.cd to be congenial 
tu enable them to perform at their best. 

Recommendations made below are based largely on the experience 
accumulated by the participants over the years. These arc not exhaustive 
by any means but some of the more important points have been covered. 

application forms and their scrutiny 

(i) Eligibility : In certain universities the procedure of asking the col¬ 
leges to scrutinise the eligibility of .students has been expcriniLiited upon. 
Since experience has shown that a further scrutiny has to he carried out 
at ihc university level in any case, there does not seem to be adequate justi¬ 
fication for delegating the job to colleges. 

{if) Late receipt of applications : Every university prescribes a last 
date for receipt of applications for each examination. Liile applications 
are ii.sually accepted on payment of a suitable late fee on the reconimen- 
daliun of the principal of the collcge/head of the deparlnicnt concerned. 
This last proviso is important because unless the schedule laid down in this 



respect is observed the university office cannot cope with all the applications 
received after the due date. 

(ill) Mechanical aids : The use of mechanical aids for the compilation 
of the lists of candidates etc. for the various examinations is exceedingly 
helpful. Universities which are not using these aids so far may start doing 
so as soon as possible. The UGC may be requested to give suitable financial 
assistance to universities for acquiring these mechanical aids. 

EXAMINATION SCHEDULES 

(i) It is important to notify the dales of commencement of various 
examinations etc. well in advance so that both teachers and students can plan 
their schedule of work accordingly. Ordinarily speaking, a student .should 
not be required to answer more than one question-paper on a single day. 

(if) Suitable accommodation in respect of examination centres is not 
always easily available. A certain amount of advance planning has therefore 
to be undertaken. To the extent possible the use of small rooms should be 
avoided because it tends to inflate the costs. 

(ill) As a matter of general principle, results should be declared within 
eight weeks of the completion of a particular examination. Sorru;liincs 
difficulties in this regard are encountered but these have to be overcome. 
Each university should take such measures as are necessary to achieve this 
objective. 

PRINTING OF QUESTION-PAPERS 

Some universities (e.specially those with larger enrolmenis) have adopted 
the practice of advance printing of question-papers at a central place whereas 
some others (especially if they happen to be small m size and residential 
in character) undertake local printing one day before the examination. V>'hile 
there is something to be said for each of these two methods, on balance it 
was recommended that universities should adopt the system of advance 
printing of question papers, subject of course to the individual require¬ 
ments of the university concerned. 

OTHER MATTERS 

(i) Custody of exauunaiional material : Tlie obvious person to he 
entrusted with and made responsible for the custody of all examination 
material, particularly that of a confidential nature, is the controller of examJ- 
nationsor the officer incharge of theexamination branch. .Since the volume 
of work in most universities is considerable, it stands to reason that he 
should be assisted in the discharge of this responsibility by another officer 
not below the rank of an assistant registrar. 

It would be necessary to maintain the same standards of re.sponsibilily 
when this material of confidential nature is transferred to examination 
centres. These centres are usually under the charge of senior profes.sors 
functioning as centre superintendents. They should be required (o lake 
special care of the custody of blank answer-books and supplementary sheets 
and maintain a proper account thereof. It would also be helpful to have 
surpri.se checks to ensure compliance with rules in this regard. 
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(ii) Seating plan : For purposes of record and reference roomwise 
seating plans of centres should be sent to the university oihcc by the centre 
superintendent. The ideal distance between two candidates should not 
be less than four feet. 

Occasionally it is useful lo change the seating plans and this fact must 
be brought to the notice of the university office. 

(Hi) Qespalch of answ'er-hook.t : Unless there arc over-riding reasons 
against it, answer-books should be de.spatched to the examiners on the same 
day. The despatch of answer-books may be organised centrally by the 
non-affiliating universities. Jn the case of affiliating universities a proce¬ 
dure should be evolved whereby answer-books are sent by the centre superin¬ 
tendent in parcels addressed fself-system) to the examiners by rail and the 
RRs are sent to the university office for re-transmission to the examiners 
after due endorsement. 

invigilation 

Invigilation duties are best performed by members of the teaching staff 
and the centre superintendent should not turn to any other source unless 
it is unavoidable or there is an emergency. Persons whose close relations 
(as defined in the convention regarding appointment of examiners) are 
appearing at an examination should not be considered eligible for the pur¬ 
pose. An important safeguard however is that 27 of the invigilators 
required at each examination centre on any day should be from outside 
that centre. As far as possible one invigilator for every 20 students is a 
norm that ought to be followed. Even if the room is small and the number 
of candidates is not all that large, two invigilators, nevertheless, should be 
appointed. 

To inspect the conduct of examinations when these are in progress is 
an important part of the university responsibility. This would be referred 
(o in detail however a little later. 

TABirL.ATORS AND COLLATORS 

Till such time as mechanical aids are not used extensively, the appoint¬ 
ment of tabulators and collators is unavoidable. Secrecy in respect of their 
appointment is also equally important. .As far as possible, teachers alone 
^llould be a.ssigiied these responsibilities. In case anyone is found guilty 
of leakage of information severe action should be taken against him. In 
regard to their appointment the best procedure scents to be that tltey are 
appointed by the vice-chancellor on the recommendation of the controller 
of examinations. 


co.mudlntial proclduRfs 


In order lo maintain secrecy of the names of the evaminers, the proce¬ 
dure of their appointment has to be reviewed. In quite a few places these 
names are submitted to the executive council or the academic council 
wiih consequent loss of secrecy. In the opinion of the seminar this system 
needs to be changed. While names may be invited from the committee 
ol OLirses or the boards of studies constituted under the provisions of 
individual university acts, the final decision ought to be taken by another 
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agency such as a special committee composed of nominees of the acade¬ 
mic council and the executive council or some other variation of this 
suggestion. Tlic decision could also vest in the vice-chancellor, provided 
he is not over-burdened with other duties. Whatever mechani.sm is evolved, 
theimportant thing to ensure is that the identity of the examiner does not 
become public. 

MASS COPYING 

In a manner of speaking, all that has been said above applies to situa¬ 
tions where things are orderly and subject, at Worst, to normal stresses and 
strains. In recent years however a new phenomenon has raised its head. 
To describe it as mass copying would be to somewhat over-state the case; 
to describe it as a widespread use of unfair means would be to somewhat 
under-.state the case. The truth lies somewhere between these two 
extremes. 

The truth of the matter is that copying on a nia-ss scale occurs only in 
certain parts of the country: it does not occur evcrvwhcrc. Secondly, 
it is a comparatively recent phenomenon and was not to be encountered 
till the last 10—15 years. Thirdly, even to describe ii as a phenomenon 
might betaken to mean that it has come to sla\’. That has not happened. 
As a matter of fact, wherever sustained and stringent efforts has c been made 
to curb this menace it has been curbed. It is useful to bear these facts 
iu mind because the problem must be seen in its correct perspective. 
Then alone can active steps be taken to combat this menace. 

A menace it is. without question. Wherever it has been encountered 
the authority of the university has been imdcrmiiiLtl. This has been accom¬ 
plished by gangs of students indulging in tolicclivc indiscipline and flouting 
of rules. This has also been accompanied by either actual violence or 
threat of violence. Consequently tlicserowdv .students manage to dcmoriilisc 
those incliarge of examination work. In ccrtaui cases soine of the invi¬ 
gilators and others turn a blind eye to what is happening. Cases have also 
been known where those incharge of arrangements have connived with 
.students. 

Without, in any way, under-rating the diflkullics ol ih.c .siiLiation ihe 
seminar felt that ihe .situation should be seen as diflictill bui not discourag¬ 
ing. Experience of several universities was quoted in this connection. 
Wherever a university had .shown the will to asseri its author! Iv the silualion 
had been brought under control. But where that had not happened, llie evil 
had spread unchecked. 

The vice-diancellor of one of the universities who was present at the 
seminar reported in detail about how lii.s university had tried, with consi¬ 
derable success, to deal with this problem. Amongst the steps taken by his 
university, the following may be mentioned: 

(fi) The first thing the university had done was to buildup the morale 
of all those concerned with examination work. The.se included 
the centre superintendents, invigilators and other supporting 
staff. fo the exlcitl that this had been done, rowdy elements 
had felt demoralised. 

(fc) The university had constituted several flying squads. These 
consisted of a small number of senior teachers whose reptiiaiion 
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for integrity was of l[ic highest ortlcr. They wcio authorised 
to make surprise visits to any centre for the purpose of delect¬ 
ing the use of unfair means. In order to be able to do this they 
were provided with transport facilities. More than that, their 
movements were always kept secret. They had also been vested 
by the university with legal powers to search any examinee 
whom they suspected inanymanner. Anumber of such raids 
hiidbecn organised with results that had been entirely salutary. 
An important pre-condition of the success of these raids was the 
availability of the police force in adequate numbers as and when 
required 

(c) In the first icar when this campaign was undertaken the number 
of cases detected Was \cry high. In the following year, because of 
the firm action taken by the university, the number of such cases 
had come down considerabis and the situation could be des¬ 
cribed as almost under control. Once it was known that the 
imisersity was nut going to show any leniency, the morale of all 
llio-sc indulging in lhc.se malpractices sagged. 

id) Though no sioicnee had acliialK been used upon any insigilator 
or centre superintendent in the course of the preceding two years, 
the threat of siolencc was always there. In order to enable 
Icachers, invigilators tind other stafi’ to function without being 
intimidated, the university bad provided for each one of them a 
form of coinpreheiisivc insurance. According to its terms, the 
university undertook to meet 100% of the c.vpcnditiirc for any 
physieal injury. Jn ca.se of any fatal incident the univer.sity 
iiiidertook to provide to the survivors of the deceased with pen¬ 
sion equal to half the salary that he was or he would have been 
drawing upto tlte period when he would have normally retired. 
This figure also included the increments iliat the deeca.ccd would 
have drawn hud he suivived. The minimum and maximum of 
tills form of pension were laid clown at Rs, 250 - and Rs. fiOO -. 
Several other ancillaiy bencfiis were also made available. Ongi- 
nally, the Life Insurance Corporation was apprciathed to pro¬ 
vide this kind ol'cover. The rates quoted however were on the 
high -ide. So the tip.iversity decided to create a fund of i.s own 
out of 1 he reinuneraiions paid to the c.vamineis. An amount 
equal to .1% was deducted from the remuneration of each exami- 
nci 'inv igilator, centre superintendent and this was put into the 
fund. The university contributed an equal amount and all 
cliargc.s were met out of this fund. Fortunately the demands 
on it so far have been almost nominal. 

e) The university luis is.sued an ordinaiiec whereby ateacher. if called 
upon, is obliged to perform invigilaiion duties. It has not been 
parliCLilarly necessary to invoke the provisions of this ordinance. 
The fact that such a provision exists on the statute book of the 
univer,sily has proved e.xtra ordinarily helpful. 

if) Wherever necessary, the support of the executive authorities had 
been obtained. In certain situaiiors even Section 144 of the 
Indian Penal Code had been invoked. This had become neces¬ 
sary to discourage parents aiul guardians gathering m large num- 
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bers near the examination centres in order to help and eoniiivc 
in the traffic oF help-books, note-books, smuggled question 
papers and answer-books, etc. As soon as students and others 
assi-sting them Found that the university authorities were deter¬ 
mined to conduct examination on their terms, whether willingly 
or unwillingly, almost everyone cooperated. 

It was clear to the seminar that the key to the solution oF the problem 
was to overcome this state oF demoralisation to which rowdy students some¬ 
times reduced the invigilation staff. The steps detailed above had helped 
to overcome this slate oF demoralisation and were to be welcomed From 1 hat 
point oF view. That this had been done by mobilising the support oFa cer¬ 
tain number oF conscientious teachers (who are not all that Few in number 
as those cynically disposed or with a faint heart were inclined to believe) 
indicated that, tackled the right way, the problem could be solved. 

The right Way lay in first arresting and then reversing the process oF the 
abdication of the authority of the university that had taken place, to sonic 
extent and in certain places, during recent years. As soon as the students 
and their helpers realised that the university was not prepared to toleralc 
violation of rules they accepted the new situation calmly, if al.‘o stoically. 
In the circumstances that exist in the country this is the best that could he 
hoped for. Unii ersities do not exist in a vacuum. They arc very much ;i 
part of the society in which they are located. Their postulates as well as 
their modes of structure and organisation are approxinialely the same as 
those of other .sectors of .social acii\il\. The trends ordcsclopmeni in other 
walks of life have inevitably hadiheir impact on the working of the univer¬ 
sities. The conduct of e.\aminalions was a particularly sensitive point of 
contact between the university and the .students and that is why in terlain 
places the situation had become increasingly difficult. By being fiini in its 
assertion of authority what the university can ensure is that mass copying 
disappears as a phenomenon, though copying by individuals would regret¬ 
tably continue. In addition to the steps reported above, the seminar 
also recommended as Follows : 

(fl) The problem should be Faced and not evaded. Unless it is Faced 
boldly and consistently and in lime it will get more and more 
complicated and difficult of solution as lime passes. Unless the 
existing unhealthy trends are checked it can even lead to a bieak- 
down of the examination .system. Timely' and cJFcetive inter¬ 
vention is therefore imperative. 

{b) While .some universities had appropriate rules and procedures in 
the Form of statutes, ordinances, regulations For taking prompt 
and decisive action to deal with cases of mass copying, others had 
yet to evolve such procedures. This is a mailer that needs imme¬ 
diate attention whether a university is coiiFronlcd with the prob¬ 
lem or not. As far as the statute book of the university is con¬ 
cerned, it must be comprehensive in all respects, even with regard 
to situations that have yet to arise. 

(c) While drawing up such regulations it must be ensured that the 
vice-chancellor is vested with sufficient powers to deal with any 
emergencies that might arise. Quite often there is no time to 
summon meetings and consult other people. That is why it is 
necessary that the vice-chancellor who is in any case the executive 
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head of the university should be explicitly vested with powers 
to deal with unforeseen situations. AVherever a university has 
an Examination. Conxmittee, all these matters may be subsequently 
reported to it. Alternatively, they can be reported to the syndi¬ 
cate/executive council. 

(d) In order to deal with the problem effectively it is important that, 
wherever required, drastic steps like cancellation of a particular 
examination^, abolition of the centre, etc. might be taken. If, 
for instance, the centre superintendent reports that at a particular 
centre or in a particular room there had been mass copying it 
should be open to the university to cancel that examination alto¬ 
gether without having to go through the formalities of having to 
prove in a court oflaw that no opportunity for defence or rebuttal 
had been provided to those affected. The seminar did not have 
enough time to go into these details but it was emphatically of the 
opinion that wherever this nuisance had raised its head it must 
be crushed promptly and decisively. 

(f) The role and authority of the centre superintendent were crucial 
to the conduct of examinations. Utmost care should therefore 
be taken to select such people who possess the requisite sense of 
commitment and toughness of character. When things are normal 
and Orderly such a requirement may not be all that invportant. 
Hut if things have deteriorated at a certain place and the situation 
has to be brought back to normal the personal attributes of 
the person/.s chosen become decisive. 

(f) It might be advantageous to arrange periodical meetings of centre 
superintendents at the university headquaters. To hold such 
a meeting after the e.xaminations are over and to hold another 
meeting before the nc.xt round of examinations is due to begin 
seems to be appropriate in terms of the calendar of the year. 
The.se mcciings do not have to necessarily transact ajiy rigidly 
laid down agenda. Rather they must enable the \ice-cliancellor 
to exchange information and experience with those involved in 
the conduct of evamination. The presence of some other pro¬ 
fessors and principals who had not functioned as superintendents 
but enjoyed a certain measure of standing in the teaching commu¬ 
nity Vvould be lielpful. These meetings could be used to review 
the existing .situation and evolve new procedures as and when 
required a.s also siart a scries of discussions aniongit the academics. 

Getting a diicussioii organised at various levels amongst 
teachers in the universities/collegcs and enlightened members of 
the public so as lo create a strong public opinion against such 
practices is a step that de.serves to be taken in any case. As slated 
above, the problem has to be faced and not evaded. One way of 
doing so is to discuss the problem openly and candidly. 

(S’) Universities .'ihould not hesitate to summon police help or the help 
of any executive authority in order lo combat those gangs of stu¬ 
dents vvhich might create an atmosphere of intimidation. Consi¬ 
derations of prestige, academic or otherwise, should not be allowed 
to stand in the way of calling the police on the camptis or 
wherever else it might be required. 
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(A) Above all. the phenomenon of mass copying is a lomment on the 
kind of instrut:tion that is ofTeied lo .sludenls in some of our 
cducalioiial institutions. What i.s taught appears lo students lo 
be neither relevant nor meaningful nor interesting. While it was 
not for llic Seminar to go into Ihi.s question in any depth, lo over¬ 
look the academic dimension of the problem would have been 
another form of evasion 

Use of unfair means 

The use of unfair means in examinations is as old as examinations them¬ 
selves. One therefore need not feel unduly defensive about it a^ one is 
obliged to feel in respect of mass copying. Tlic primary dillercnce between 
these two phenomena is that in the case of mass copying .students opcniv 
defy the canons of academic propriety whereas while using unfair means 
students are afraid of being found out and disgraced. Even in respect of 
these cases there has been a steep increase in recent years but this is not si' 
alarming as the phenomenon of mass copying practised in ccitaiii parts of 
the country. 

Fn regard to the use of unfair means most universities alreadv jsosscss 
a certain amount of experience. Tlie following rccommendaiions were 
made on the basis of a certain pooling of experience that a number of parti¬ 
cipants brought to bear on iheproblcnc ; 

(a) Unfair means can be used(i) before the examination (n) duiing 
thecxamination anv1 (liil after the examination. Each oiieoflhc'c 
cases has to be dealt wnh in its own way, 

{b) Before the examination the commonest form of unfair mc.ins 
is the leakage of the question papers. This can lake place at ll,c 
level of the paper-setter or the moderator s or the .stall concerned 
in the unixersitv office or anyone working m the printing press 
or the centre stipcrinteiidcni who is cuirusicd with the qiic^tioii- 
p.'ipcr''. Over ll e vears moM univeisiiiis lia'c evolved a kmd oi 
System t.b.iut it. .A' reported at the seminar, there was etirsi- 
derablc di'cf-.ils in respect vf If.ese airangements. To evolvi. 
a uniform system \v\iuiJ be unworkable. The seminar did rm 
pursue this question beyond ibis poinl that the failure in mo-' nl 
these cases is ilial of a paiiicular indiMdaal. Amongst oil.cr 
atirihuLcs, all those eonne^icd with the process ol prcparalmi] nl 
question-papers should be reliable persons in ilie best sense ol il.c 
word. Wherever any kind of weakness is delected such a peisiin 
must be eliminated from the chain. 

Yet another safeguard can be the one reLOnunended m rcspcci 
of the pool of question-papers suggested elsewlicre in these pro¬ 
ceedings, If a large number of question papers are prepai td and 
the ultimate decision as to which one is used rests only with one- 
individual this problem could be overcome to a great extent. 

(c) In the course of the examination a whole variety of ilungs can 
happen. It is not possible lo give an answer to each one of them 
in advance. As a matter of fact it is surprising how those wl-.o 
wish to use unfair means hit upon newer and newer methods of 
doing so. Their sense of improvisation would be impressive 
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were it not For the bad motivation. A few of the situations 
commonly encountered may be mentioned here however : 

(d) Use of books and notes brought into the examination hall 
requires nothing better than alertness on the part of the invi¬ 
gilators. 

((>) Smuggling of question-papers outside the examination hall 
and smuggling of written answer-books into the hall are also 
phenomena that can be encountered by greater vigilance’on 
the part of the invigilators. 

(/) Impersonation, though not very frequent, is a danger that has 
to be guarded against. It is more prevalent in the case of private 
students than in the case of regular students. In such cases 
apart from the attendance-sheets where each student is re¬ 
quired to sign, special arrangements can be made in respect 
of private candidates. For instance, they may be required 
to sign on a kind of passbook which carries an attested photo¬ 
graph of theirs and there is additional space for his signatures. 
Ti’ese should be taken everyday and duly countersigned by 
ihc invigilator. In the case of regular students they may be 
required to produce their identity cards as and when neces- 
sa ry, 

(gl When a case of Lise of unfair means is deiected. it is important 
that reporting is done in the appropriate manner bringing 
out the detailed facts relating to the occurrence. In fact 
it was suggesiCLl that reporting must be done in terms of a 
standard proforma. In this connection attention was drawn 
to the profoima being used by Gorakhpur University. It 
is given (.see appendix AI a.s a kind of model which can be 
adopted fur use as required. 

(/i) Since decisions lakeii in this regard are subject to judicial 
review, due precautions must be taken. For instance, the 
enquirv nnisi indeed be fair and the examinee must be given 
adequate opportunity to defend himself. Not only that, the 
enquiring authority must scrupulously cb.-erve the principles 
of natural justice in conducting the enquiry, though it is not 
necessary to apply^all those considerations that govern criminal 
trials in the courts. 

(i) Since the requirement of natural jusrice regarding the pro¬ 
cedure of enquiry depends to a great extent on the facts and 
circiiinsLances of each case the enquiring auihoriiy must strictly 
follow the rules and procedure prescribed by the university code 
in this behalf. 

(/) In order to alford an adequate opporiuiiiiy of defence the 
charges framed against the .student must be clear and the 
evidences intended to be used against him must be brought 
to his notice. He should be given an opportunity to explain or 
rebut the evidence. If he makes a request for personal hearing 
or permission to inspect any document the request should 
not be denied in case such a procedure or facility is necessary 
for putting up a defence. 

(k) Paper-sctiers, examiners, invigilators, ami all others directly 
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concerned with the conduct of examinations should be treated 
as public servants within the meaning of the law for all 
practical purposes. This will not only ensure that they can 
be prosecuted in a court of law for dereliction of duty 
but will also give them added protection against use of vio¬ 
lence on the part of those who resort to unfair means. 

(I) Whether examiners, invigilators and others connected with the 
conduct of examinations can be treated as public servants or 
not is a matter that requires legal examination. Without 
any prejudice to this issue the procedures regarding use 
of unfair means now in force in universities might also be 
re-examined from the legal point of view. In a few cases 
law courts had passed strictures against universities. This must 
be avoided at all costs. 

SPACING AND FREQUENCY OF EXAMINATIO.NS 

The traditional practice in our universities so far has been of one final 
examination at the end of the course. This has been criticised on several 
grounds. Amongst the changes effected in recent years, two may be 
mentioned In the case of the three-year degree eourse majority of uni¬ 
versities now hold an examination at the end of every year. The second 
change has been the introduction of the semester system in certain univer¬ 
sities. For the greater part it is used in professional faculties and at 
the post-graduate level. In a few cases however it has been enforced 
even in respect of under-graduate course. But the number of univer¬ 
sities that have switched over to the semester system is not particularly 
large as yet. Consequently the frequency of examinations is an issue 
with regard to wh ch the seminar could not take a firm position. This 
is a ma ter which needs to be discussed in the larger context and in rela¬ 
tion to the system prevailing in thar university. ,\ll that the seminar could 
agree upon was that there sho.ild be one examination at the end of an 
academic year and, wherever possible, there may be two exammations 
with the necessary introduction of the semester system at the post-graduate 
level, particularly in professional examinations 
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Six 


Post 3valuation To ds 


To VISIT A uiinersil) office when awards are being received and tabulated 
presents a strange contrast to the atmosphere which prevails when question 
papers are being framed and other preparations are being made. The chief 
difference lies in this. When these awards start flowing in there is a lot of 
work to be got through on time and so a sense of crisis is generated. Al¬ 
most every job has to be completed by a given date. Any kind of delay 
means delay in the publication of the result which never enhances the repu¬ 
tation of the university. In this crisis-laden atmoitphere. so to speak, a good 
deal depends upon the inter-personal relations already established by the 
head of the e.xaniinaiion branch with his staff. If the relations are harmoni¬ 
ous everyone cooperates in the spirit of “the job has got to be done”. But 
if there are strains of any kind, whether hidden or overt, the situation becom- 
!s difficult. 

In addition to this problem, there is also the other problem of getting 
wards on time. Quite a number of examiners fail to comply with the dead¬ 
line laid down. Some of them are so consistent in their violation of rules 
ind norms that persons with a long experience in the examination branch 
:an, in quite a few cases, anticipate the extent of delay that will take place. 
IJere are also odd cases of scripts being delayed in transit or lost, award 
meets going astray and a host of other irritations with which the um’versity 
'taff n\ore or less learn to Ivve. 

To come to the specific jobs which have to be done by the examinaiion 
branch, these may be listed as below: 

(a) tyhen the schedule of dates for the commencement of the examina¬ 
tion is drawn up, a schedule in respect of all post evaluation 
jobs should also be drawn up. Amongst the points to be covered 
should be the receipt of answer-books, the receipt of awards, 
commencement and completion of tabulation work and pubUca- 



tion of results, etc. White drawing up this schedule naturally 
due consideration will be given to the number of candidates for 
each examination and also, it is hoped, to the recommendation 
made elsewhere that the results should be published within H 
weeks of the last date of the examination. 

(6) In terms of inter-personal relations, it is advisable that the sche¬ 
dule should be drawn up not by the head of the examination 
branch alone but in consultation with the various concerned 
branches. This will help in promoting a sense of involvement on 
the part of everyone concerned. 

(.f) Immediately after the receipt of scripts from the examiners, the 
checkers should be asked to run through every page of the script 
valued by examiners. Mistakes, if any, must be brought to the 
notice of the scrutineer who will satisfy himself that the mistake 
is genuine. The checker’s job is to point out the mistake. He 
docs not liaxe the authority to make any change or correction. 
This can be done only by the scrutiny officer. Even his authority is 
limited in so far as he can correct mistakes of totalling, etc. Bui 
if any question or pan of a question is left unmarked, that has goi 
10 go back either to the examiner or to the head examiner. 

Ul) The role of checkers and scrutineers is exceedingly importam 
While no figures ha\c been compiled by any university, the inci¬ 
dence of mistakes committed is quite high, li is important lo 
ensure therefore that this job is done carefully as well a^ 
efficcintly. 

(,e) Evidently a ceiling has to be placed on the number of scripts 
that a checker can handle. The scmiiuir thought something like 
5.000 should be appropriate. This would keep him busy for 
1.5-20 days at the rale of 3t)0 or so scripts a day. In terms ol 
remuneration. Rs. 35,- for l.0(K) answer-books should be the appro¬ 
priate rate of payment. In the ca.se of scrutiny officers. Rs. 15 - 
per day wa.s recoin mended. Certain universities ha\c chid 
scrutiny officcr.s also; they may be paid Rs. 20'- per day. 

( f) After scripts have been processed in the university office it is the 
turn of the tabulators to gel busy. So far. in most universities 
tabulation is done manually. .A.s recommended elsewhere, 
the seminar was of the view that it is desirable lo have the aids 
of calculators, adding machines and such other aids. The use 
of these aids makc.s for speed as well as accuracy. 

ig) Where machines arc not being used, and this is true of mo.st uni¬ 
versities today, this part of the job takes quite a long lime and 
is regarded as a tedious part of the whole opcralon. Bui there is 
no escape from it and the job has got to be done on time. In a 
certain number of universities, staff from other branches of the 
university office is mobilised for a few days so as to cope with the 
rush of work. When mechanical aids can be used exten-sively, 
the need for additional hands would disappear. 

(/j) After the raw results have been prepared, the senior staff are 
expected to undertake a kind of statistical analysis. This is 
the time to use lho.se methods of scaling to which reference ha.s 
licen mad< cl.sewhciv in ihi.v Report. While scaling would lake 
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care of a great many of the odditecs that come to notice, the 
rest can be taken care of through methods of scaling and modera¬ 
tion referred to elsewhere in the Report. So no more need to be 
said here. The only thing to emphasise is that since neither of 
these two methods are being used at most places the existing situa¬ 
tion is profoundly unsatisfactory. 

( i) The job of checking and tabulation, etc. requires attention to detail 
and a certain amount of organisation. Scaling and moderation 
however are skilled operations and cannot be undertaken exc^t 
by those who have been trained in these skills. Organising 
workshops and institutes for the training of examination staff 
is a matter of considerable importance therefore and needs to be 
given high priority. 

M.\RKS SHFETS 

In order to be able to get admission to the next class, especially in 
the case of professional courses, students require mark,grade sheets almost 
at the same time as the examination results are declared. This require¬ 
ment of students has posed difficulties for many universities. Those few of 
thorn that have access to mechanical aids have been able to solve their pro¬ 
blem successfully. The rest have to get it done manually and this takes 
lime. Since it takes time and the need of the student is urgent, the semi¬ 
nar felt that at the outside detailed marks seehts should be supplied to 
students,'colleges not later than 7 days after the publication of the result. 
To delay it longer would not he de.sirable. 

'TRIFirATION OF VfARKS 

Almost every university entertains applications for verification of marks 
obtained by the candidates. This is difl'erenl from re-assessing the scripts. 
That issue has been discussed elsewhere in the Report and need not be refer¬ 
red to here. As far as verification of marks is concerned this should be 
continued, it being clearly understood that the virilication will be done only 
by the officer incliargc of (he examination work or by someone equally re.'- 
ponsible. 
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Seven 


Organisational Set "Jp 


Administrative arrangements in regard to examination work differ from 
university to university. This is bound to be so. Despite this diversity, 
the seminar devoted some attention to discussing what may be, loosely 
speaking, described as the ideal organisational .set'Up. 

When numbers were small the registrar of the university handled every¬ 
thing. An important part of his duty was to organise and conduct examina¬ 
tions. But as numbers began to increase, delegation of responsibility became 
unavoidable. At a certain stage of development, a senior official wa.v 
appointed to take charge of these arrangements. Sometimes he was called 
the deputy registrar (examinations). Sometimes he was called the controller 
of examinations. Whatever be the designation, in most universities the regis¬ 
trar continued to be either formally or informally incharge of the examina¬ 
tion work. In certain other universities however the controller of examina¬ 
tions was given independent charge of this work. That is to say, he did not 
deal with the vice-chancellor through the registrar but directly. 

This is a trend that has been growing for sometime. Whether this 
trend grows stronger or not would depend upon a number of factors, an 
important one of them being the growth in numbers. As a result of consi¬ 
derable discussion, the seminar felt that without upsetting arrangement.s 
which are functioning satisfactorily in certain universities, it would he 
advisable to evolve a system under which the controller of examinations is 
vested with exclusive responsibility for the work relating to examination. 
That the controller would also be assisted by a deputy controller and/or 
assistant controller(s) goes without saying. Clearly, the quantum of the 
supporting staff would depend upra the individual needs of the university 
concerned. 



UNITS OF ORGANISATION 

The work of the examination branch may be divided in terms of the 
following jobs that have to be done : 

(i) Registration, enrolment, checking of eligibility forms, listing ol 
candidates, etc. 

(i7) Registration of private/extemal candidates, including scrutiny ol 
their application forms for admission to the examinations, etc. 
(h 7) Arrangements for conducting examinations, etc. 

(ir) Confidential section. 

(r) Computerisation section wherever mechanical aids are available. 
(17) Follow-up action in respect of unfair means cases. 

As would be seen, work in the first two units is like work in other u nit- 
of the university offices. The only important thing to ensure is that the per; 
sons put incharge of this work must have an eye for detail. Any inaccUracj 
will get reflected in later work and might cause problems. Unit (///) handles 
work of an important nature. Any kind of oversight or overlap in regarc 
to conduct of examinations can upset arrangements at a crucial moment. 
Experience acquired over the years is a great asset and it seems advisable 
not to lose this experience (in this section as in others) unless it is un¬ 
avoidable. Some people in the unit are also required to visit centres 
located at distant places and ensure suitable arrangements there. In this 
regard also experience of having done the job earlier is useful. 

confidential section 


The pivot of the whole operation however is the confidential section. 
This section deals with a whole variety of things. It deals with the appoint¬ 
ment of paper-setters and examiners. It deals with the framing, moderation, 
custody, printing and despatch of question papers. As a matter of fact 
getting the question papers printed is not only an important job. it also 
implies a lot of hard work, correspondence, proof-reading and such other 
matters. Over the years, as has been found by experience, v'igilance in respect 
of the printing &. handling of question papers is crucial. In quite a few 
cases leakages have occurred because of laxity of arrangements at this level. 
Fictitious roll numbers are also allotted by this particular section. Once 
the results start flowing in they have to be tabulated and compiled by this 
very section, though in certain universities they also allow other sections 
to handle this work. This is for the reason that the fictitious roll numbers 
are held in safe custody by the confidential section and others, even if the> 
are dealing with the tabulation of results cannot get to know what they arc 
handling. The moderation and preparation of results is again a confiden¬ 
tial operation which has to be handled by this very section. Altogether it 
will be seen that the success or failure of the examination work handled bj’ a 
university lies essentially in the competence and confidentiality with which 
this particular section functions. 


What are to be the conditions of service and remuneration of those 
working in this section is a question that will be examined a little later. 

With the increasing use of mechanical aids some of the universities 
have set up a computerisation section as well. Since the number of such 
universities is not very large, there is not much field experience to provide 
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the basis for any detailed comments. It is visualised that in the course oT 
time more and more universities would set up these sections. 

One of the important jobs that the examination section of any univcrsitv 
has to do relates to the follow-up action in respect of those who have been 
detected using unfair means. This is a highly responsible work and requires 
considerable attention to procedural mailers. If someone with legal back¬ 
ground can be found to handle it. that would be most satisraciorv. 

STAFF STJtUCTURF 

Two conflicting points of views were expressed in regard to this is.sLie 
According to one view, the structure should be vertical. That is, there 
should be clerks, senior clerks, assistants and superintendents in the asceml- 
ing order, dealing with a particular set of responsibilities. This is the system 
followed in the other branches of the universiis office and to follow it in the 
examination branch would be only consistent. The other point of view wa.-. 
that the structure should not be vertical but should consist of different, .self- 
contained units. Each unit should be under the charge of a person who 
may be a superintendent or an assistant controller depending upon the nature 
and quantum of the work insolved. The efficient working of the unit should 
be entirely the responsibility of the person incharge of the unit. Of course 
he would be a.ssisted by assistants and clerks as the case might be. 

While the seminar did not come to any deliniic decision, it recogni.scd 
that in the case of the second alternative the output was greater. W'liai 
is more, in terms of this system it is possible to li,\ responsibility in ca.se 
there is any kind or lapse or leakage. After all it is easier to locate responsi¬ 
bility when the person s handling a job is arc known iliai when responsibi¬ 
lity is not strictly localised, 

rOVDITIONS Of srRMCt 

Before norms for stalf recruilnieiil are discussed, a seems imporianl lo 
refer to the conditions of service of persons working in the examinaiion 
branch. Looked at from one point of view, they are university enlp'oyee^ 
like anyone else in the office. There is no question fhererorc of their condi¬ 
tions of service being difierent. There is another point ofvicw also however 
.Since the nature of their work demands greater devo'iiua to duly at certain 
times of the year, their conditions of service should not be equated with the 
.service conditions of other university employees. To elaborate, a mislaki 
made in any other branch of the university office may not have the same 
consequences (except possibly in the finance branch) as the mistake madi 
in the examination branch. Persons working in this liekl of opcralionare 
therefore required to be more alert and more responsible. Quite often then- 
work is not vetted or checked by anyone else and the chimce.s of a niistakc 
remaining undetected are always there. Secondly, the schedules of exami¬ 
nation and all other steps connected with their conduct and organisation arc 
pre-determined. Dead lines for every little thing arc fixed and (ho.se have 
to be complied with. It is all a link in the chain. This might mean thai 
some people have to put in longer hours of w'ork during certain months oi' 
the year. 

In the case of the junior staff, paying overtime is a recognised practice 
in most places. In the ca.se of senior staff the same practice cannot be. 
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iind should not be, applied. Yet some of them have to put in long hours 
(ifwork, week after week and month after month, 

This is neither fair nor a solution to the problem (as described above) 
in the long run. A number of suggestions were made in this regard but no 
conclusion could be arrived at for the problem needs more searching exami¬ 
nation. if for instance, they are to be regarded like those employees of a 
bank who handle cash and are therefore given cash allowance, these jobs 
might be coveted by quite some others in the office. The university authori¬ 
ties however may not regard them as suitable in the same measure and so 
problems might arise. If senior persons working in the examination branch 
are put in a different .scale of pay, difficulties of the same kind, as referred to 
above, might arise. Then there is the further question : should these 
people be transferred to other Jobs within the office or should they stay on 
ill the examination branch year after year? If the second course is followed. 
•Ahat avenues of promotion are open to them? There is a whole host of 
issues which needs to be considered in much greater detail. 

It was brought to the notic-c of the seminar in this connection that in 
certain universities, the registrar, or the controller of examinations as the 
ca.se might be. was paid one or two months' additional salary. 

NORMS or STAl 1 Rf.CRl ITMr.N I 

Once the conditions of service have been decided by a university, the 
next question to be considered is: what should be the norms of staff recruit¬ 
ment? Only a few suggestions, more or le.ss in the nature of general princi¬ 
ples. can be made here. 

The lowest category of recruitment is that of clerks. Every university 
has laid down certain norms of selection. The.se norms can be applied 
to the examination branch as to any other branch. The general calibre of 
those available is not alway.s satisfactory. Perhaps the only thing which the 
university authorities can do in this regard is to select the more competent 
ones for work in the examination brancli. Indeed the nature of responsi¬ 
bility to be handled in this branch justifies such an approach. 

It is in the selection of assistants that utmost care and rigour should be 
exercised. Assistants are given jobs of considerable responsibilitv. They 
form the backbone of work in the examination branch. Furthermore, once 
a person has been found fit enough to hold the assistant's post and if there 
IS nothing on record against him. he is likely to get promoted when his turn 
comes. In other words, the element of selection should come into play 
much more decisively at the level of the assistant than at any later level. 
Promotions beyond this point arc likely to be more or less automatic. There¬ 
fore every care must be taken to ensure that the assistants selected are of Ihe 
right orientation and calibre. It follows from what has been said above 
that not more than 50'^., persons .selected lor the post of assistants should 
come amongst the ranks of clerks and the remaining .SO'Io should be selected 
(rom the open market, it being understood that they will be university gra¬ 
duates. Even out of the 50% promoted from amongst the clerks, not more 
than 3/5 should be promoted on the basis of seniority alone. The remaining 
2.''5 should be selected because they are competent. 

Since it has been suggested above that the cut out point in respect of 
automatic promotions should be the job of the assistant, the'.senior assistants 
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and the superintendents would get promoted more or less as their turn comes. 
The seminar however thought that, even at this level, at last 25% of the jobs 
should go to candidates who pass a selection test. Automatic promotion 
is likely to prejudice the chances of those who have capability but not senior¬ 
ity. 

It does not require much effort to show that generally automatic promo¬ 
tion acts as a kind of dis-incentive. Whatever be the quality of a person's 
work, he knows that he will get promoted when his turn comes. This 
attitude cannot be rejected out of hand in a society where jobs are scarce 
and subjective factors play a considerable part in personnel policies. Des¬ 
pite these powerful reasons, beyond a certain point seniority cannot be given 
precedence over competence. This applies particularly to jobs above the 
level of a superintendent. To have an assistant controller or a controller 
of examinations selected on the basis of seniority alone can prove disastrous. 
This is not to suggest that competence, when found within the ranks of the 
existing staff, should not be given its due. This is only to stress the impor¬ 
tance of proper selection at the senior levels of administration in a sensitive 
area like examination work. 

BUILDING AND EQUIPMENT 

In quite a few universities, particularly those which were established 
quite sometime ago and where increasing numbers have oulstriped provision 
of physical facilities, it is not unusual to find the examination branch 
housed in an unsuitable building. Sometimes, it is not housed in one build¬ 
ing but spread over several buildings, though this is not to suggest that access 
from one building to another is always difficult. Suitable office space is 
an important contributory factor in favour of the efficiency of operations. 
Every university must therefore make sure that the examination branch is 
adequately housed. In view of its specialised functioning, the building 
should be designed and constructed in such a way that the following require¬ 
ments are met: 

(a) While those working in the confidential section may have access 
to other sections of the branch, others should not hu\e access to 
the confidential section. This is an elementary kind of precaution 
that has to be taken. The design of the building sometimes does 
not facilitate the separation of one section from the other. This 
must be ensured. 

(b) Moderation of question papers as well as of results is a confidential 
operation. Sometimes more than one moderation committee 
is required to meet at the same time. So unless there is an ade¬ 
quate number of meeting rooms for this purpose (situated in the 
confidential section, it goes without saying) the work may get im¬ 
peded. 

(c) Sometimes meetings of examiners have to be held. Then there are 
checkers and scrutineers who have to be wroking for several 
days at a stretch. Suitable accommodation has to be found in 
respect of each of these persons. 

(d) For the storage of question papers, whether in the manuscript 
form or after these have been printed, a separate strong room must 
be provided. This must be more than a mere store room. Adja- 
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cent to it there should be some additional space which can be 
used as the work area. 

(e) Scripts have to be stored in such a manner that if some of them 
have to be retrieved in connection with rechecking or any other 
purpose, this can be done without any loss of time. Quite some 
universities have learnt through experience that to leave scripts 
lying around leads to considerable wastage of time. 

(/) There has to be adequate space for confidential records as well. 
In order to ensure fixation of responsibility in case of any leakage, 
it is important that jobs should be so assigned that only one or two 
individuals are put incharge of a specific operation. Once this is 
accepted, it follows that access of those individuals to their respec¬ 
tive areas of work should be free and unhindered so that persons 
can come and go without violating norms of secrecy whether of 
their own work or that of others. 

TRANSPORT 

In order to be able to transport examination material to examination 
centres and sometimes persons connected with examination work, it is im¬ 
portant to place a suitable transport at the disposal of the controller of exa¬ 
minations. Universities which have done so have found that in this way 
their work proceeds more efliciently. In an emergency perhaps no branch 
of the university needs as much mobility as the examination branch. 

rVAMIVATION RECORDS 

This can be classified into two categories; (o) those which are required 
for some time, and (h) those which are to be preserved on a permanent 
basis. 

In respect of permanent records, tabulated registers should be pre¬ 
served permanently. This is a kind of record w hich may be required at any 
stage. This requires considerable storage space which all universities are 
not in a position to find. One .solution, an expensive one though, is to micro¬ 
film these tabulated registers. The seminar did not go into the economics 
ol this question. It needs to be investigated further. 

OTHER RECORDS 

Scripts which have been valued need not be kept beyond a pieriod of 6 
months after (he publication of the result. Marks slips may be preserved 
for a period of one year. It is important however to preserve the applica¬ 
tion forms of the candidalcs for a longer period, say 10 years. 

auditing and accounting 

Expenditure in the confidential branch is usually incurred by the regis¬ 
trar or the controller of examinations under the direction and supervision, 
of the vice-chancellor. This is the practice in almost every university. 
When it comes to the auditing of accounts however, there is the delicate issue 
of secrecy. Should the auditors be given access to confidential records? 
If so, how is the university to ensure that the identity of the printing press 
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where the question papers are printed will remain undisclosed? The semi¬ 
nar did not go very closely into this question. But, as a series of interim 
recommendations, it suggested as follows; 

fa) There should be no objection, in principle, to external audit ol' 
transactions handled by the conlidential branch. 

(b) The actual mode of operation should be a matter of negotiation 
between the university and the audit authorities. 

(c) In case the audit is being done by the Government, it should be 
entrusted to a senior person, say a deputy accoutant general, 
who should personally handle this work, delegation in this res¬ 
pect cannot be handled lightly. 

i.d) The audit should be conducted in the presence of cither the vice- 
chancellor or the pro-vice-chancellor who have sanctioned all the 
expenditure incurred by the confidental branch. In case any 
question is to be answered, that should be done on the spot 
Of course it is understood that the registrar or the control'er of 
examinations, as the casie might be. would also be present. 

fe) The auditors should not ask for any information in regard to the 
source of printing of confidential documents. This is an adminis¬ 
trative matter. All that they are concerned with is if the amount 
has been si)ent according to rules and regulations. In other 
words the auditors will concern themselves with the rate.-, of 
printing as duly approved by the vice-chancellor and the order" 
placed for the printing of question papers and not other details. 

(/) In regard to the payments made to the persons engaged in the 
confidential work, the identity of such persons does not have he 
disclosed. 

(g) The registrar/controller of examinations should maintain a .sub¬ 
sidiary cash book detailing therein the iransaclions of the amoiini 
recei\ed from the unisersify for disbursement. 
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Imp.ementation, Innovation 
and ^.esearc-i 


Till. S1.MINAR LiRLi) to bolifse llui its (Jelihcratioiis were, in an imporiant 
sense, qualitatively (JilTerenl from deliberations oPearlicr seminars and con- 
I'ercnccs on the theme ore.xamination reform. So as lo coiKretise this belief, 
the seminar took care to en.surc two things. One. to make such recom¬ 
mendations as could be implemented in terms of its diagno.sis of the pro¬ 
blem and the capacits of ihe s\slem to adjust to new solutions. Two. to 
include amongst these recommendations the cslablishment of a Central 
Unit concerned with problcm.s of implemcnlaiion. innotalion and research. 

Despite all the careihai the seminar took lo make its recommendations 
concrete and practicable, some people nia> still find them somewhat vague 
and impracticable. To lake an instance, the proposal dealing with the re¬ 
designing of question-papers is not an easy one to implement. But it cannot 
be said that it cannot be inipUmented. It can be implemented provided, 
and this is an important proviso, both students and teachers interact and 
collaborate in tht implementation of this proposal actively as well as crea¬ 
tively. 

The chief nitriis of this proposal ari ivso. Oiil. to repeat, it in\ oIvls the 
students as well as the lcachcr.s in the proctss of re-designing question- 
papers. Two, while everything else remains the same in the complex sys¬ 
tem called the public e.xamiiiation. the range and quality of the questions 
set undergo signilieant Iransfornialion. It needs no great efTort to show that 
if this transformation can be effected successfully it will have a profound 
impact on the qualitv of instruction imparted in our colleges and univer- 
tics. 

As the Education Conimi.ssion noted, the public c.xaniinaiion system 
will be with us for a long time. This opinion is very Widely shared and the 
seminar too recognised that even when other innovations arc made it would 
not be possible to replace this sj'steni by a new one. For one thing, the 



effort involved would be beyond the resources of the academic community. 
For another, the society at large Was not likely to accept any new system 
Or structure so easily. That being so, a way had to be found of working 
within the existing system and reforming it, so to speak, from within. 

The proposal to re-design question-papers is the outcome precisely 
of this approach. The proposal recognises the fact that examinations 
vill continue to be conducted by the university, question papers will be got 
set by it, arrangements regarding the conduct of examination would also 
be handled by it and that examiners as well as paper-setters too would be 
appointed by it. All the.se different stages of the examination process would 
be controlled by an impersonal agency outside the teacher. Whatever may 
be Said against this system, and a good deal has been and will continue to be 
Said, the system has endured and will not be changed so easily. ]f without 
changing the system it was desired to make a significant innovation, how 
could it be done? Thi.s was the issue to which the seminar addressed itself. 
In response, it evolved the proposal of establishing a pool of questions in 
every university. 

To introduce an innovation of such a far-reaching character without 
fully involving those concerned with it. and this refers to students as well 
as to teachers, would be utterly unthinkable. Of the various proposals 
made by the seminar this, in a sense, is the most important as well as the 
most difficult to implement. The difficulties of implementation however 
did not di.scourage the seminar from making it. Resistance to it can come 
from several quarters. Maybe .students do not welcome the proposal. Mav- 
be some teachers regard it as completely contrary to their existing mode of 
functioning. These are real difficulties and no useful purpose will be served 
by under-rating them. To over-rate them however is to decide in advance 
that no change is possible. The seminar did not subscribe to this position 
and that is why it iniide the proposal with a sense of humility as well as 
earnestness. 

CENTRAL I'MT 

This is being said not by way of a dercncc of what has been staled 
above. The reeomnicndalions made by the seminar dc.strvc to stand or fall 
on their own merit. If they are practicable, and the seminar did its best 
to see that thty were not vague and idealistic, this can be tested by c.vpc- 
rience. If some of them need to be amended in any manner and made more 
down-to-earth and realistic, that should be perfectly in order. As a maitci 
of fact, the seminar also made a complementary recommendation to ensure 
that the matter is not simply forgotten at the conclusion of the seminar. 
It therefore proposed the establishment of a Central Unit to plan & think 
of new proposals as well as implement the proposals made by this seminar 
and any subsequent proposals that might be evolved by the said Unit- 
Speaking concretely, the seminar recommended the following to be the chief 
functions of this Unit;— 

(fl) to analyse question-papers, their composition, character and 
language; 

(i) to suggest ways of improving paper-setting and a.sscssmcnt; 

(c) to organise training programmes in testing practices and instruc¬ 
tional objectives for teachers, paper-setters and examiners: 
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{d) to analyse examination results and prepare reports; 

(e) to undertake studies and experimentation on social, pedagogical 
and psychological aspects of examinations; 

' f'' to offer suitable programmes to secure cooperation of teachers, 
students and guardians in the improvement of the examination 
system; 

(g) to provide feedback of the relevant information to the appropriate 
bodies through boards of studies, etc.; 

(/;) to suggest improvements in syllabus, methods of teaching.paper¬ 
setting and assessment in different subjects of the curriculum 
based on the findings of the Unit; 

(/) to arrange and provide for the preservation and processing of data 
relating to examinations; 

i /■) to coordinate its findings and programmes with public service 
e-ommissions. .secondary .school boards, UGC, NCERT, Indian 
Statistical Institute, Indian Intitule of Management, Science 
Talent Search Organization and such other bodies in India 
and abroad; and 

(/,) to undertake the publication of a news letie." or a journal on a re¬ 
gular basis and other studies on a periodic basis. 

Il does not seem necessarx to offer an\ elaborate reasons for the esta¬ 
blishment of such a Unit. The functions as enumerated above (and this 
is by no means a definitive list) are not being performed by any organisa¬ 
tion'agenc\/unit today. Over the last two decades a number of attempts 
base been made at the unixcrsiiy level as well as at the national level to ini¬ 
tiate certain reforms. To what cvient these initiatives have led to fruitful 
results is a matter of common knowledge and need not be commented 
upon here. The fact of the matter is that things have remained substantially 
what they were, sav. as compared to even half a century ago. The prolifera¬ 
tion of numbers and institutions has made the problem so much more com¬ 
plicated that the universities can ignore it now oiilv at the cost of losing their 
public image as well as their credibility as institutions of higher learning. 
The question to ask therefore is not whv such a Unit is necessary but why it 
has not been established so far. 

L'NIVERSITY U-MTS 

The necessity of a Unit at the central level is so obvious that no more 
need be said about it. But equally obvious and important is the establish¬ 
ment of such units at the universities which conduct examinations and 
declare results. A central unit however active and efficient will not be able 
to achieve much on its own. It w'ill have to operate through university 
units and in close cooperation and coordination with them. Looked at from 
this point of view, university units are the key to whatever academic engineer¬ 
ing the community of teachers and students wishes to undertake. 

The establishment and organisation of a Central Unit can be handled 
only centrally. In respect of university units it is open to a university 
to take initiative and embark upon a programme of reforms and changes. 
The seminar therefore devoted some time to discussing how this may be done. 
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Amongst the specific recommendations that it made, the following may be 
mentioned : 

(fl) The unit should work as an independent entity which should bo 
directly responsible to the vice-chancellor. The head of the unit 
should preferably be a person with the standing and/or rank of a 
professor. This alone would give him the necessary leverage 
v/j-fl-vij the rest of the academic community. In addition, there 
will be adequate supporting staff and they would be expected to 
possess the requisite technical competence. 

(A) The unit should have easy access to the office of the controller 
of examinations as well as that of the registrar. It should work 
through such committee/s as may be considered necessay. It 
should also invite specialists in thefield/subjects to secure wider 
participation in itswork of analysis, research and implementation. 

(f) In Order to secure maximum involvement of those concerned a 
number of people from colleges, in the case of affiliating univer 
sities. should be associated with the work of the unit. 

fOLLtOJ; UNITS 

As a matter of fact a would be advisable to have eollege unjis as well. 
The responsibility of these units would not be the same us that of universiiv 
units. That is because examinations are arranged and conducted by the 
universities. To that extent the bulk of the data for analysis and all othei 
problems connected with the reform of exaniinatioiT, cun be found onl\ at 
the university level. But the university units would not be able to inifiaie 
and conduct any changes or experiineniswithoutthecooperalion of teacher- 
and students. This makes it nece.vsary as well as usefal that colleges loo 
should have units dealing with examination reform. The principal 
ously should be clo.selv associated with it, in addition to several representa¬ 
tives from various departments. The chairman of the unit should be a per¬ 
son conversant with the techniques of cvaluulion and c.xamination. If at 
any stage internal assessment is to be organised by a eollege this unii could 
also play an imporlam role in its organisation and elheient conduct. 

CONCLUSION 


Put simply, the seminar recommended a structure oi'organisations deal¬ 
ing with examinations at various levels of operations. Establishment of a 
central unit is imperative partly to get the movement of examination reform 
going and parily to coordinate the worm being done or proposed to be done 
at various universities. The most vital part of the job will however be done 
at the university level. The power of certification, and that is what exami¬ 
nations essentially are, is vested bylaw in the universities. According 
to the Indian Constitution, no other institution except a universiiv 
can award a degree. Its mode and mechanism for awarding those degrec- 
hoWever has neither been as valid nor as relible as it ought to have been. 
It is for the universities now to examine their powers in respect of examina¬ 
tions and to ensure that these powers are exercised validly, icliably and 
justly. 
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The role of the central unit however is likely to prove of crucirl signifi¬ 
cance in the years to come, assuming that it gets established. Historicallv 
speaking, since 1947 initiatives have come largely from the Centre. Funds 
too have come largely from that source. Professional expertise also is more 
easily available to the Centre than to the States or the universities located 
in them. Without the Centre providing the leadership as well as playing a 
dynamic role in this task, the task may not get done at all. It is as simple 
as that. 
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Statement adopted jy t-ie Seminar 


In spite of the widespread recognition that the system of examinations 
in the country requires considerable overhauling not much has been done 
during the last few decades. The existence of the problem was recognised 
by the Radhakrishnan Commission and has been endorsed by the subse¬ 
quent Commissions. Now, because of the pressure of numbers, a stage 
has been reached where the system is beginning to break down. 

At the same time, the seminar is convinced of the fact that lack of pro¬ 
gress in this regard has not been entirely owing to lack of resources. The 
resources required to carry out the desired changes and innovations are with¬ 
in the means of most universities. What has been lacking all these years 
has been initiative and the desire to change. The seminar therefore appeals 
to the university community to overcome this crippling inertia and pay im¬ 
mediate attention to problems of assessment and evaluation which are so 
crucial to the academic process. 

The seminar recognised that as things have evolved the system of public 
examinations has come to stay. Most recent attempts at changing the 
system have been concerned with introducing internal assessment pro¬ 
gressively. In principle, the seminar is in favour of internal assessment. 
Its large scale introduction however would be possible only after adequate 
preparations are made and necessary administrative safeguards are provided, 
The seminar therefore affirms that most of the innovations that can be intro¬ 
duced have to be either within the framework of the public examinations 
system or through a judicious combination of this system with the internal 
assessment system. 

In the opinion of the seminar the imperative need is to improve upon 
the existing system and streamline it by ensuring greater reliability as well 
as greater objectivity. In this connection, amongst other recommendations 
the seminar recommended as follows; 



(a) It attached the highest importance to the re-designing of question- 
napers. The bane of the traditional system has not been so much that it is 
external as that it is repetitive and stereotyped. Even while retaining 
the external framework, changes can be introduced within the system. The 
most obvious as well as the most crucial change is that of re-designing the 

question-papers. 

Two myths in this connection need to be exploded. One, that the 
Question paper must not expect answers to more than 5-6 questions. Two, 
i rat questions cannot be repeated from the question paper of the preced¬ 
ing year. These myths will take a long time to die but steps in this direction 
ought to be initiated rightaway. 

As a part of the foregoing, question-papers shoud make only a partial 
use of the essay type questions. Other types of questions can also be intro¬ 
duced so that the course content examined is not patchy but comprehensive 
and cramming gets discouraged. The seminar also made other detailed 
recommendations. 

(b) Regarding the controversy of marks versus grades, the seminar was 
of the view that it is an unreal controversy. The important thing for the 
universities is to ensure the relative ranking of a given batch of students in 
a particular examination. If employing agencies as well a sprofessional 
institutions and universities in the country give due importance to this rela¬ 
tive ranking (the percentile basis of awards) the unhealthy emphasis on 
marks and grades would disappear. 

(f) One unfortunate feature of the conduct of examinations in recent 
years has been copyine by the examinees on a mass scale in some universi¬ 
ties. This is a comment on the educational system as much as an expression 
lof social tensions. To the extent that the universities are concerned the pro¬ 
blem ought to and can be overcome by (/) improving the tone and efficiency 
of teaching and (//) by strengthening university administration. A few uni¬ 
versities have achieved these two objectives successfully as reported at the 
iseminar. 

! (d) With the enormous increase in numbers the universities are finding it 

lincreasingly difficult to cope with the demands of examination work made 
jupon them. To a considerable extent these difficulties can be and have been 
'oercome by the use of mechanical aids. The seminar strongly recommended 
ito all universities in India and Ceylon that each one of them should equip 
ilself with data processing machines so that both efficiency and accuracy 
.arc ensured. It is also desirable to restrict the si/e of the university so as 
to enable it to function as an efficient unit. 

(e) While it is important to strengthen the university administration all 
round, it is particularly important to strengthen the examination wings as 
niost of the pressure of increasing numbers is felt at that point. 

(f) The seminar expressed itself strongly in favour of introducing 
the semester system of examination wherever possible and feasible. 

(g) And finally the seminar called upon the University Grants Com¬ 
mission and the Inter-University Board to organise a well staffed Unit at 
Ihe national level for research into problems of examinations. This organisa- 
lioti can also promote the establishment of similar units in the various 
universities and colleges and also undertake training of people in the new 
techniques, locally as well as nationally. The establishment of such a unit 
is of vital importance otherwise the situation is bound to deteriorate. 
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Appendix A 


?orm for reporting cases o: 
uniair means 


EXAMINATION. 19 


Candidate’s Roll No. Enrolment No. 

Name of candidate (with full postal address) 

Name of candidate's father 

Name of institution (in case of college — 

candidate only) — 

Name of centre 

Subjwt and paper in which the candi-1 Subject 
date is reported to have used or attemp- Paper 
ted to use unfair means 

Day Date Time 

I. Particulars of books, papers etc. found in possession of the candidate 
iind submitted along with the answer books and this report (All these 
should be signed by the Superintendent). 

1. Name of book | 1. 

1 2 . 

I 3- 

2. Number of torn leaves of books 



3. Number of(l) manuscript slips, 1. 
(2) sheets, (3) blotting paper 2. 

4. Any other article I 1. 

2 . 

3. 


II. Statement of candidate to be obtained at once in his own handwriting 

1. Were the above articles recov¬ 
ered from your possession, per¬ 
son, desk, etc? 

2. Why did you have them inspile 

of clear instructions? — 

3. Did you make any use of them? 

4. Have you anything else to state? 

Certified that this statement was made in my presence. 

Certified that the candidate declined to give any statement. 

Certificate not applicable should be crossed by the Superintendent. 


Superintendent 

Date 


Signature of the candidate 
Date — 


III. Report of the invigilator 


Signature of the invigilator 

Date- 

Time- 

IV. Report of the Superintendent of the examination centre 

Superintendent 

Date- 

Time- 


V. Report of the Head Examiner: 

1. Did the candidate make any use of the material? 

2. If not could the candidate make any use of it: 
Further report: 

Recommendations: 


74 









Marks gained by the candidate in the paper 
Date — 


Examiner 


VI. Recommendation (if any) of the Registrar 


Registrar 


VII. Final order in the case 


Vice-Chancellor 

CHARGE SHEET 


Roll No.- 

Candidate’s name Sri- — 

Father's name Sri 

Address-—- 

District 

Institution 

Centre — - — 

It appears that you used unfair means and committed an act of moral 
offence as well as indiscipline while answer¬ 
ing paper at the exa¬ 

mination of 19 in which you appeared on 

from centre with as your Roll 

Number. 


PARTICULARS OF CHARGES 

The Tnvigilator/Centre Superintendent/University In-spector 

recovered from your possession on at 

a.in./p.m. while you were answering Paper 

at — Centre 

from within/beneath your desk/answer-book/pocket 

The Invigilator further reports that he found you copying/you had 
copied from the unauthorised material recovered from your possession. 


The aforesaid unauthorised material related to paper, the 

questions of which you were answering. 

In your signed statement dated given before the Centre 

Superintendent you have admitted that the aforesaid unauthorised mate¬ 
rial ( ) was in your possession at the time of its recovery and 

that you had made use of it in solving Q.No. -of — 

paper. 
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Tbfi Centre Superintendent and the Invigilator concerned report that 
you refused to give on the spot your statement on the charge-sheet issued 
to you by the Centre Superintendent and furhter/also refused to take second 
answer-book issued to you by the Centre Superintendent, for writing 
further answers to the said question paper. 


You defied university’s instruction No. by exchanging your 

question paper with that of the candidate bearing Roll No. 
and by giving solution of question No. on the question paper/ 

blotting paper to the candidate bearing Roll No. in the 

examination room/ on 

The Head Examiner reports that you could have made use of the afore¬ 
said material in answering question No. of 

Paper and that you could have also made use of it if other questions/relat¬ 
ing to the aforesaid material should have been set in the said question paper. 

You are charged for having used unfair means at the examination of 
19 

You are also charged for having committed an act(s) of indiscipline by 
refusing (i) to give on the spot your statement and your explanation to the 
Centre Superintendent, (ii) to put your signature(s) on the unauthorised 
material recovered from your possession/by swallowing the unauthorised 
materials with the intention of destroying the material evidence against 
you/by abusing, calling names to/using filthy language/by threatening the 
Invigilator(s) and the Centre Superintendent concerned/by running away 
from the examination room before the scheduled time by 


at the university’s examination of 19 

There is a prima facie case against you that you used unfair means/ 
committed an act of moral offence/as well as indiscipline at the university's 
examination 19 . 

It is, proposed to take action against you under clause —of Exami¬ 

nation (General) Ordinances of the University. You are asked to show 
cause why suitable action should not be taken against you under the afore¬ 
said Regulation. 

Your explanation should reach Registrar (by name) by 
19 . On receipt of your explanation the Deans’ Committee will 

consider your nase. If no explanation is received from you on of before 
the date mentioned above, the Deans' Committee will considere your case 
ex-parte. 


Registrar 
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Appendix B 


Analysis o: information received 
from tlie Universities 


As part of the preparation for the seminar the Bord requested universi¬ 
ties to supply information with regard to rules, regulations and practices 
in the field of examination work current in the various universities. Fifty- 
six universities/institutions responded to the circular, though it cannot be 
said that the information is complete in all respects. (If the name of a univer¬ 
sity where a particular practice is current is not found in this list, this may 
be owing to information not having been supplied). On the basis of the data 
thus collected an analysis in respect of few important heads was carried out 
in the office. Some of the more relevant parts of this analysis arc being pre¬ 
sented here so as to provide a factual basis for the discussions that, it is hop¬ 
ed, will be stimulated by the report of the seminar; 

Semester System: The under-mentioned universities have introduced the 
semester system at the ier-gridute level: 

Faculty of Arts: (1) Agra (Home Arts). (2) Aligarh, (3) Meerut. 

Faculty of Science : (1) Agra (Home Science), (2) Aligarh. (3) B.H.U. 
(4) Meerut, (5) Poona, (6) Punjabi (Physics-Honours). (7) ShivaJL 

Faculty of Social Sciences: Aligarh. 

Family of Commerce: (1) Aligarh, (2) B.H.U.. (3) Meerut. 

Faculty of Engineering: (1) Aligarh. (2) Allahabad. (3) Annamalai, 
(4) Gorakhpur, (5) Gujarat. (6) I.I.Ts. (Delhi, Kanpur, Madras), (7) JaHav- 
Ptir, (8) Jodhpur, (9) Karnatak, (10) Kurukshetra, ^1) Marathwada, (12) 
Mysore, 113) Nagpur, (14) Panjab, (15) Poona, (16) Punjabi, (17) Roorkee, 
(18) Sardar Patel, (19) Saurashtra, (20) Sfaivaji. (21) Venkateswara. 

Faculty of Agriculture: (1) University of Agricultural Sciences, Banga¬ 
lore, (2) J.N.K.V., Jabalpur, (3) fl.H.U., (4) Punjab Agricultural Univer- 
ityi (5) U.P. Agricultural University. 



faculty of Law'. (1) (2) Delhi, (3) Meerut, (4) Saurashtra, 

(5) Udaipur. 

When it comes tg post-graduate courses, the situation is different in 
different faculties. In the Faculty of Arts, for instance,the following univer¬ 
sities have introduced it. 

(0 Agra (Social Work, Statistics & Sociology), (2) Aligarh, (3) Delhi 
(English, Mathematics, Punjabi, Urdu, Political Science and Social Work), 
(4) Madurai, f5) Meerut, (6) Saurashtra, (7) Udaipur. 

In the Faculty of Science, the following universities, have introduced it; 

(1) Aligarh, (2) BHU, (3) Delhi, (4) Gorakhpur, (5) Madurai, (6) 
Meerut, (7) Poona, (8) Punjabi iPhysics only), (9) Roorkee, (10) Sardar 
Patel, (11) Saurashtra, (12) Shivaji, (13) Udaipur. 

Internal Assessment: Information with regard to this head is neither 
adequate nor clearly demarcated between under-graduate and post-graduate 
levels. On the basis of whatever is available, the under-mentioned univer¬ 
sities have introduced the system of Internal Assessment in the various 
faculties as mentioned against their name; 

(1) University of Agricultural Science, Bangalore (Agriculture), (2) 
Aligarh (all faculties). (3) Annamalai (Engineering, Agriculture and Educa¬ 
tion), (4) Delhi (M.A. in English only). (5) Gauhati (Medicine. Engineering 
and Science—practicals only), (6; Gujarat (Arts, Science, Commerce and 
Medicine), (7) I.I.Ts. (Delhi, Kanpur, Madras)—(Engineering). (8) Kania- 
tak (Engineering), (9) Madurai [B.Sc. special degree course, M.A. (English 
only) and B.E.], (10) Marathwada (Engineering, Medicine). (JI) Mysore 
(Engineering, Education and Master degree courses). (12) Panjab (Pre- 
Medical, Pre-Engineering and B.Sc.—Practicals only), (13) Poona (Science 
and Engineering). (14) Punjab Agricultural University (Agriculture), (15) 
Roorkee (Engineering), (16) Sardar Patel (Science and Engineering), (17) 
Saurashtra (Arts, Science and Commerce), (18) Shivaji (Science). (19) 
S.N.D.T. fHome Science and Education). (20) Sri Venkateswara (Medicine 
and Engineering). (21) Udaipur (Agriculture), (22) U.P. Agricultural (Agri¬ 
culture). 

Scrutiny of Marks: Pre-scrutiny of marks is done by the following 
universities before the declaration of the results. At other places the check¬ 
ing of marks is done only on students’ request. 

(1) Baroda, (2) Gauhati, (3) Jadavpur (B.A. & M.A.), (4) Karnatak, 
(5) Meerut, (6) Nagpur, (7) Sardar Patel, (8) Shivaji, (9) S.N.D.T. 

Scaling of Results: Only the University of Gauhati has experimented 
succesfully with the scaling of results. 

Re-assessment of Scripts: Two universities, Agra and Meerut, have 
provision for re-assessment of scripts. This can be done on the request 
of candidates on payment of a re-examination fee. In case the re-assessment 
differs from the earlier assessment by more than 15. 8 and 5 or more marks 
carrying 100, 50 and 25 marks respectively the fee is refundable. The 
decision to permit re-assessment is with the vice-chancellor who appoints 
three outside examiners, one of them ordinarily a paper-setter, for this pur¬ 
pose. The average of the three is regarded as the final score. 

All these details refer to Meerut University. Agra which is the other 
university to embark upon this experiment is in the process of evolving 
its own procedures. 
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Frequency of Examinations: The following universities have provided 
for the university examination at the end of each year of their degree 
course: (I) Allahabad, (2) Awadhesh Pratap Singh, (3) B.H.U. (B.A,), (4) 
Bhagalpur (B.Sc. & B.Com.), (5) Bhopal, f6) Burdwan, 0) Calcutta, (8) 
Delhi, (9) Dibrugarh, (10) Gauhati, (I I) Gorakhpur (B.Com.), (12) Gujarat, 
tl3) Jabalpur, (14) Jadavpur (B.Sc.), (15) Lucknow, (16) Panjab, (17) Rabin- 
dra Bharati (B.A.), (18) S.N.D.T. (B.A.), (19) Udaipur, (20) Vikram. 

Re-appearance at University Examination: The following universities 
have allowed their postgraduates to re-appear at the examination to improve 
their division: (I) Delhi, (2) Gauhati, (3) Meerut, (4) Panjab,(5) Punjabi, 

(6) Shivaji, (7) Udaipur. 

Mechanical Aids: Though the necessity of application of mechanical 
aids is widely recognised, only the following universities have taken the help 
of mechanical aids in streamlining their examination processes so far: (1) 
Baroda, (2) Gujarat, (3) Mysore, (4) Punjabi, (5) Sardar Patel, (6) Shivaji, 

(7) Sri Venkateswara. 

Examination fees: The fees charged for the under-graduate and the post- 
craduate examination in the faculties of arts, science, commerce, medicine 
engineering and agriculture show wide divergence. The details are given 
on the next pages. 
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STATEMENT SHOWING EXAMINATION FEES 


Note : + Fees Biven in order of 
£ Fees given in order of 
• Fees per semester, 
%[nformation is partial. 
NA—Not Available. 

(Fees in Rs.) 


Name of University B.A-/fl.Sc./B.Com.+ M.A.)M.Sc./M.Com.+ 



Part 1 

Part 11 

Part III 

Previous 

Final 

1. Agra 

27/27/27 

ninin 

_/_ 1 _ 

27/27/27 

37/37/37 

7. Aligarh .. 

(io;io/iO)* 

(10/10,'I0)» 

(io/io;iO)» 

(15/15/15)* 

(15/15/15)* 

3. Allahabad 

25/25/25 

35;35./35 

-/-/- 

30/30,30 

40/40/40 

4. Annamalai 

NA NA/NA NA/NA/NA NA,NA/NA 

70/75,70 

80/100,80 

5. A. P. Singh 

30,35,30 

30 35/30 

40.45,'30 

45,50/45 

45/50,45 

6. B.H.U. 

42,42 30* 

42/42.30 

—/—/JO* 

34,34,60 

34,34,72 

7. Berhampur 

50/50,/50 

50 50 50 

50/50,50 

40,40,‘40 

45/45,45 

8. Calcutta .. 

25/25,25 

30, 30 30 

——/— 

50/50/— 

50/50/80 

9. Delhi 

15 15,15 

15,15,15 

1515 15 

tIS 15/15)* 

(15 15 15)* 

10. Dibrugarh 

25,;25;25 

30/30,30 

_ _ 

75/75*— 

75 75 - 

11. Gorakhpur 

30 30,30 

30/30,30 

—J - 

.10,'26*,30 

.40 27* 40 

12. Gujarat .. 

30 40,30 

40,45.'40 

50,50/50 

50 75,60 

50, 75 60 

13. Indore 

20 20 20 

30/30,30 

30,30 30 

30 30 30 

40 40,40 

14. Jadavpur.. 

.30 30/— 

40,30,— 

— 

-/45;.- 

80,45,.— 

15. Jiwaji 

22 27'22 

32 32 32 

32,32.32 

32 37, .12 

42 42 42 

16. Jodhpur .. 

33 3.1,33 

33 33 33 

40 40 40 

27,27 27 

40 40 40 

17. Kalyani .. 

40 40 — 

. 45,45 — 

_. 

50 60 — 

50,60 — 

18. Karnataka 

40 50 40 

40 50 40 

40, 50 40 

50,60,50 

50 60,50 

19. Kurukshcira 

2833,':8 

28 33'28 

28 33 38 

48 63,— 

48 63 - 

20. Mysore .. 

40 40 40 

—.'—,— 

50,60 50 

50,50 50 

70 7 0 70 

21. Nagpur ,. 

35.40 35 

45 45 45 

——; -. 

45'50,45 

45 50 45 

22. North Bengal 

30 30,30 

30,30/30 

_1_ 

NA,NA,'NA 

NA NA.'NA 

23. Osmania 

NA.NA/NA NA,NA'NA 

NA,NA/NA 

44 55,44 

44 5 5 44 

24. Panjab 

26,'31/36 

2631,36 

31,31 .16 

.55,75.61 

55 75171 

25. Poona 

40t60t40 

4OtS0t4O 

—1—t— 

45160*.55 

45,60* 55 

26. Punjabi .. 

25/30/35 

25,/30,35 

30/30,35 

54,60'— 

54 60,- 

27. Rajasthan 

35/35/35 

35/35/35 

42/42/42 

29/29,29 

42 42,42 

28. Ravkhankar 

30/35/30 

30,'35/30 

30,35,.10 

45/50,45 

45/50'45 

29. Roorkee .. 

—!—l— 

/ f 

—/—/— 

—,'70/— 

- ,.70 — 

30. Sambalpur 

25/25/25 

50,'50/50 


40,40,- 

45145185 

31. Sardar Patel 

33/43/33 

43/53/43 

53,'63.53 

60/60/60 

60/60/60 

32. Saurashtra 

32/42/32 

42/47/42 

52/52/52 

-/-/_ 

102/152/122 

33. Shivaji 

40/60/40 

40/30%,/40 

40/30%/40 

45/60/55 

45,/60/55 

34. S.N.D.T. 

40/—,'— 

60/-/— 

-/-/_ 

50/—/— 

50/-/— 

35. Sri Veokateswara 

32/32/32 

60/65/60 

-/-/_ 

42/42/42 

42/42/42 

36. Udaipur .. 

35/35/35 

35/35/35 

40/40/40 

40/40/40 

40/40/40 

37. Vikram .. 

30/35/30 

35/35/35 

40/45/40 

45/50/45 

45,'50/45 


80 





charged for various courses 

Arls, Science and Commerce. 

Medicine, Engineering and Agricullure. 


M.B.B.S. B.Sc(Engg) Or B.F.. B.Se.(.Ag)*£ 


Part 1 

Part 11 

21142121 

22,'47'37 

40/25/— 

50'25,'— 

NA'NA/25 

NA'NA;35 

NA,/40,'30 

NA 40 30 

40(601— 

60t60t— 

NA^NA.'44 

N A/NA '44 

50'—'- 

35/—'— 

15/40 — 

35'50'— 

NA.NA NA 

NA/NA'NA 

60.'60/— 

50 60.'— 

—/55/30 

-,■55.40 

40/40 — 

.50,40 — 

35/50,— 

60,55— 

—'NA,'— 

—,'NA'— 

40'N A/'— 

80 NA,— 

— 70 — 

— 70 — 

—/40 

— — 45 

60/40*,— 

30 40*,'- 

-,'28;3S 

-.33 38 

30/30'— 

20 30 — 

50.'60'- 

60.60'— 

50 40/ — 

NA 40 — 

1 

rl 

rl 

72/22'— 

56,40,'41 

5 6,'45.51 

60/70,'— 

65/70.'- 

55/85,'— 

55''95,.— 

35,67'35 

67/67 35 

40/80/— 

60/80 — 

— '60,'— 

—.60.— 

50,'25/— 

35/30,.'— 

—,'43/43 

-,'53'53 

42/42/52 

52/52/62 

60/30/— 

65/30/— 

! 1 

_ j _ 1 _ 

121/42/— 

72/'42/- 

-/-/40 

—.''—,'40 

40/50/— 

25/50/— 


Part III 

Part IV 

57'52'— 

52 57'— 

55'35 — 

—'.35'- 

NA.'NA 35 

.— 

NA'40,40 

NAt50l50 

60t60(— 

—(601- 

NANA'44 

— NA 44 

25 — 

60,—,'— 

15.'—'— 

40 ■-,■■— 

NA/NA NA 

NA'NA NA 

50 60 — 

-.60- 

-,’55'— 

■-55'— 

75,60— 

-IS — 

60 65.'— 

— '65,'— 

—'NA'- 

- 'NA — 

HONA- 

- NA— 

—'70 — 

-'80'- 

-NA 

-,-.45 

50,70 — 

too 70 — 

- 38 43 

- 38,48 

20 30,— 

30/30 — 

70 60'— 

-60 — 

NA;40 — 

NA 40,'— 

83.30 — 

— 35 — 

81 50,61 

-55,71 

70,90,'— 

- 90 .1— 

80.105 — 

-/I15- 

82167/42 

— 82,'— 

60'80.— 

—'80 — 

—'60 — 

— 100 — 

25.,40,/— 

60 45 — 

—■63/63 

—'73,— 

71/62..'72 

—.'77— 

70/30/— 

/ 

— 100 — 

1_._ 

105/60/— 

—.60,'— 

—1—140 

—.'— 

60.60/- 

80.'60'— 


Part V 


—'35/— 

NAteOt— 

— 160 ,,— 

—'NA'— 

40.—'— 

NA NA 'N'A 
— '60 — 

- 100 '— 

— '70 — 

—''NA’— 

—'NA— 

—.]00 — 


-43— 

- 60 — 
—60— 
NA,40 — 
-'45 — 



- 102 .'— 
—.'80'— 

/ / 

— 60/— 
— 103/— 


-■60,— 
— ' 601 — 
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Formu'ating 3cucational Objectives 


R.S. TRIVEDI 


iHL BASIC gutSTiON 111 the direction ol cxamniiition reforms is wh} are 
wc imparting instructions? What is the purpose? What are the goals? 
This basic issue needs a little clarification, for. the science of examination 
demands correlation ofobjectives. programme.s and procediircsof inslruc- 
tions. The end product ultimately be exalualed in terms of knowledge, 
skills and ability to use knowledge and skills de\eloped during his stay at 
ilic university. 

In this context the following goals may be visualised; (i) to introduce 
siiidenls to the world of intellectual curiosity, (ii) to invite them into the 
realms of free inquiry,(iii)to slimulateihem to discover truth, (iv) to deve¬ 
lop in them sense of values, and (v) to develop in them a social conscious¬ 
ness, In short, the total picture ofthe product of the university should be 
that students should be properly cultivated men and women because, 
iificrall. they will bethe leaders in difTcren! spheres of life. 

It is desirable that ihcsc aims should be m.ide more speeilL to Jialde 
ihe university teacher to visualise the desired outcomes, A good 
teacher is not interested in seeing Imi the sluilcnis arc but what they be- 
comi\ 

MAJOR OflJECTlVlS : 

(i) to develop up-to-date knowledge of principles, facts, concepis. 
theories, procedures, etc; 

(ii) to develop varied types ofskills: 

(iii) to develop self-study habits: 

(iv) to develop the ability to apply the acquired knowledge and skills 
in new situations.; 

(vj to develop ability in critical thinking (Part of (iv)); 



(vi) to develop varied interests, e.g., in academic pursuits, practica 
work, research, etc. 

(vii) to develop the scientific attitude (analytical mind). 

To be more d^nite it is very necessary that these objectives are mad. 
more specific in terms of ‘Course objectives’. 

The analysis of some of the major objectives in terms of specification 
is given below as an illustration. 

KNOWLEDGE : 

the ability to recall facts, theories, etc., in a selective manner; 

the ability to be aware of the sources of knowledge; 

the ability to discriminate values, ideals, etc.; 

the ability to recognize principles, facts, etc.; 

the ability to see relationships; 

the ability to classify facts, etc., on the basis of developed criteria 
the ability to organise facts, etc., into a meaningful whole; 
the ability to draw conclusion or infer; 

the ability to compare facts, principles, thcoric.s, processes, etc,; 
the ability to explain in technical terms precisely and accuralcl} 
concepts, phenomena etc. 

Note : To realise the above, it is felt that the pre-requisite should b( 

(i) the ability to listen to oral talks, lectures, etc., with concentration aiu 

(ii) to judge a lecture and note down salient points. This is pointed on 
because at present ‘Lectures’ dominate the instructional programme n 
the colleges. 

APPLICATION : 

the ability to apply principles, criteria, etc., in new situations; 

the ability to interpret phenomena, findings, etc; 

the ability to predict the course in a reaction, etc; 

the ability to detect errors and rectify them; 

the ability to devise new procedures, apparatus, etc.; and 

the ability to design new plans, tools, etc. 

SKILLS ; 

The basic or the fundamental skills in 11.e theoretical and operation;! 
aspects are acquired by students as part of the knowledge. When these 
skills are used in an unfamiliar situation there is scope for application o 
the acquired skills. 

the ability to plan experiments, etc; 
the ability to perform experiments, etc; 
the ability to manipulate instruments, etc 
the ability to do computational work; 
the ability to draw sketches and diagrams; 


2 



the ability to draw technical drawings; 
the ability to tabulate data; 

the ability to calculate & interpret the tabulated data; 
the ability to handle tools, machines, etc. 

In addition to the above, it is to be considered that some competencies 
are exclusive to the fields of Arts Sl Humanities. A few illustrative abilities 
are given below: 

ability to recognize form and pattern in literary works as a means of 
understanding their meaning; 

ability to be aware of acceptance usage of articles; pronunciation, 
capitalisation, etc., as a means of effective presentation; 
ability to read significant writings with critical comprehension; 
ability to listen to oral talks with concentration and to critically judge 
the same; 

ability to write with proper organisation of ideas; 

ability to write for pleasure, entertainment and for providing information 

for others; 

ability to develop individual style of writing; 
ability to deliver extempore speeches. 

instructional programmes to develop desired COMPL I tNClES 

The factors which have direct impact on the attainment of the objectives 

are; 

(i) courses of studies, 

(ii) teaching procedures, 

(iii) medium of instructions, 

(iv) library and laboratory facilities, 

(v) the college schedule. 

The factors having indirect impact arc ; 

(i) admissions, 

(ii) the structure of the classroom, 

(iii) administration and organization of the college, 

(iv) discipline and general tone of the college, 

(v) activities usually known as cultural and extra-curricular, 

(vi) the nature of appointments of college teachers. 

This classification is neither rigid nor all-inclusive, it is only sug¬ 
gestive. 

The direct as well as the indirect factors are so much interrelated that 
it is not possible to isolate the impact of a single factor from that of others. 

In the context of the impact of these factors, any reform in exami¬ 
nation is worth thinking. Any innovation for the sake of innovation and 
devoid of reality-context will serve no purpose. 

Some of the universities have introduced semester system in a typically 
Indian style. The entire paper-oriented attitude has been shifted to course- 
orientation. The natural outcome is instead of giving more opportunities 
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to talk, to read, to discuss, to refer to other resource material, students 
are subject to various types of examinations in the form of quizzes, short 
tests, etc. The new Indian semester style is examination ridden instead of 
learning-oriented. The failures are turned out compulsorily as dropout.s 
instead of being given opportunity to improve by relearning. The result.s 
are declared yearwise and courses are conducted semester-wise. In some 
places semester-evaluation is continued with external-examination pattern 
of instruction. It is to be remembered that semester is a pattern of ins¬ 
tructional procedures and not evaluation procedures. 

Therefore, to improve examination system in India the first requisite 
is to make our objective clear and specific and to bring a radical change 
in the instructional programmes of higher education. 

SUGGESTIONS TOR CHANGE : 

1. Let experience and performance gain greater importance. 

2. Let the individuals be judged on what they can do rather than 
where and how long they have gone to school. 

.1. Try people on jobs and assess their performance. 

4. Cultivate talents in those who are now disadvantaged. 

.T. Recognise the educational and occupational potential ofmanv 
who have difficulty with educational systems as they are presently 
conducted. 

6. Accept education and training as a discontinuous proces.sin the 
case ofthose who had not the benefit to continue education. Give 
them scope to re-enter and benefit from education. 

7. Once a dropout is always a dropout; this belief be soon discarded. 
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The lecturer’s complaint that students work only for examinations is 
legitimate so long as the examinations are merely a test of knowledge by 
repetition. If we can compose examinations which test a student’s response 
to the unfamiliar also, we will have taken a big step towards the corre'ation 
of question-setting with adequate instructional objectives. Let us admit 
however that the clarihcation of instructional objectives is an important 
and necessary task in relation to each course of study. As universities we 
have before us the example of NCERT which, in relation to high schools 
has done far more than any university I know to rewrite syllabuses in the 
form of educational objectives. 

Our present system of examinations is for the most part a sequence 
of essay-type questions testing thecapacity to repeat information and tech¬ 
niques. Essay questions can be used to test the highest intellectual abili¬ 
ties, but whether they are used in this way depends more on the valuer 
than on the paper-setter. The very open-endedness of essay-type questions 
is both their strength andtheir weakness; their strength, because they leave 
room for the most able students to show themselves; their weakness, be¬ 
cause there is no check to pevent either students or valuers treating the 
questions as tests of knowledge only. 

If we are looking for a precise correlation between question setting and 
instructional objectives, essay questions are of very little help, and I fear 
that, temporarily at least, their importance in our pattern of examining 
may have to be reduced. We will obtain precision if and only if we can 
set questions which demand the exercise of the intellectual skills we wish to 
test and which do not leave room for misinterpretation or devaluation by 
lecturer or valuer. 

There are three ways of setting questions which do this. One is the 
short answer question which may be illustrated by the following example. 

Example 1. Write complete, grammatical, intelligible and neat answers. 

You will be graded on all these features. 

(a) List the assumptions of the Kinetic Theory of Gases. 

(b) Name two physical phenomena explainable by this theory. 

(c) Define temperature in terms ofthe Kinetic Theory. 

(d) (i) Sketch a graph of Charles’law labelling the axes 

with appropriate physical quantities. 

(ii) What does the origin represent ? 

(e) How would you prove experipien tally that some molecules 
move faster than others at the same temperature? 

in this example, the essay question “Discuss the Kinetic Theory of Gases” 
has been broken down into a number of short answer questions. This 
form of question is particularly suitable for literature exams. Another 
way of making precise demands on a student is to ask him to supply part 
of a sentence that is missing. 

Example 1. On heating a mixture of solid chloride and solid potassium 

dichromate with concentrated sulphuric acid,_is formed. 

A third way, that is now becoming a very widely used form is the multiple- 
choice question. 

Example 3. Which of the following economic policies is most likely to 
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produce effects that are inconsistent with the effects of the others : 

(a) Liberalizing instalment buying plans. 

(b) Increasing public works spending. 

(c) Lowering interest rates. 

(d) Increasing ejtpenditures for industrial plant and equipment. 

(e) Increasing taxes. 

All these three types of question are far more suitable than the essay 
type for precision in testing special abilities and for reliability of assessment. 
Moreover, a large number of short questions provide for a much more 
thorough coverage of a syllabus than a small number of long ones. 

In order to use these short questions effectively it is necessary for the 
Board of Studies in question or the paper-setting committee to say precise¬ 
ly whatintellectualabilities should be exhibitedin relation to each item of 
the syllabus. Then a two-dimensional blue-print for an examination can 
be built up. 

intellectual abilities; 

Knowledge Under- Applica- Creative 
standing tion Thinking 

SYLLABUS 1. 

CONTENT 2. 

SUBJECTS 3. 

4. 

5. 

This blue-print should show how the questions ought to be distributed bet¬ 
ween the various topics and the intellectual skills. 

The actual construction of short questions is itself a special skill. In 
particular, the technique of setting valid and reliable multiple-choice tests 
has become a science in its own right. It seems desirable for all educators 
to be at least initiatedinto this science, andforthis purpose it may be useful 
to mention the text, “Measuring Educational Achievement” by Ebel and 
“Constructing Achievement Tests” by Gronlund, both published by Pren¬ 
tice-Hall and also the material available from the Educational Testing 
Services, Princeton, USA. The paper-setting committee at least will require 
.special training in this science. Such a training programme is a realistic 
proposal because compared with either the lecturers or the valuers, the 
paper-setters are a small group. Moreover the influence oftliis small group 
dominates almost all the classwork in our universities. 

SUMMARY: 

The essential reform that we require is to include in our examinations, 
not only tests of knowledge, but also tests of understanding, application 
and the student’s response to new situations. Such tests can be built in 
to the usual written examinations if educational objectives have been clear¬ 
ly stated and questions demanding a specific limited response are set. The 
construction of such tests requires special training for the paper- 
setters. 
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Designing o: Question Paper 

D. M, DESAI 


IMPROVEMENT OF EVALfATlON TOOLS 

One CRUCIAL ASPECT of examination reformat an) stage of instruction is the 
improvement of evaluation tools. Improvement of tools would in\ohc: 
(1) pressing into service a variety of tools that would be most relevant and 
appropriate to different instructional objectives that are to be measured 
and (2) perfecting and sharpening each of these tools technically. The 
most disturbing inadequacy of examinations in the school system as well 
as in colleges and universities is that the essay question is being used as the 
sole tool of examination: not only that,enough care and competence do not 
always go into the framing of essay questions. A good programme of 
examination should use a variety of evaluation tools, such as the es.say test, 
the short-answer questions, the objective type item.V. the guided written 
assignments, the tutorial term papers, field work or practical work report, 
book reviews, critical notes, viva-voce, etc. The tools should be adequate, 
in variety as well as in types, to the instructional outcomes ihal arc to be 
appraised. This paper is limited to the discussion of the technical aspectN 
offraming an examination question paper and the improvement ofits indi¬ 
vidual questions. 

PLANNING ON EXAMINATION QUESTION PAPER 

A good examination question paper needs careful, adequate and appro¬ 
priate planning. When it is used to appraise the full one year study, com¬ 
prising of many hours of work done by students and decide the academic 
future of hundreds of students, a good deal of thinking and care should 
go into the framing of each question paper in the examination, and appro¬ 
priate decisions should be taken in regard to its various aspects and com¬ 
ponents. A good Question Paper cannot be framed without pre-plafifiihi. 



The planning of an Examination Question Paper should be based on 
the criteria of effective testing, such as those given below: (1) Adequate 
coverageof instructional objectives; (2) adequate sampling of the prescribed 
syllabus; (3) suitability of the form or type of individual questions in light 
ofthe instructional objectives to be evaluated andthe nature ofthe subject- 
content to be covered; (4) scope and length of individual questions in the 
light ofthe total lime apportioned to the question paper andthe nature of 
iheinstructional objective to be evaluated; (5) grading of individual ques¬ 
tions from simple to difficult; (6) whether options in questions are to be 
given or not; (7) distribution of marks in different questions and in diffe¬ 
rent content areas; and (8) the time factor. 

This kind of planning would amount to the preparation of a Two 
D'nm^fisiofial Chart or the Blue Print ofthe Question Paper andtaking deci¬ 
sions on; (1) the total time to be allotted to the question paper (which is 
usually prescribed under university examination rules); (2) the form of indi- 
\idual questions; (3) the weightage in terms of (a) number of questions 
and (b) marks to be given to questions of recall or memory, knowledge, 
application, critical reasoning and appreciation: and (4) whether options 
are to be provided in the question paper. 

1 will briefly deal with these aspects of the planning of a Question Paper. 
PRFPARATION OF A TWO DIMENSIOKAL CHART 

It will be necessary for the Chairman of the Board of Paper Setters to 
prepare before hand the draft plan of a Two Dimensional Chart for the 
Question Paper, This can be finalised later on by discussion in the meeting 
with the other paper setters. The Chart should specify at least the follow¬ 
ing; (1) On the horizontal side, iheinstructional objectives that are to be 
ineu.sured; (2) On the vertical side, the content areas in which the ques¬ 
tions arc to be set; (3) In each ofthe box framed by giving the lines under 
‘objective’ and-‘content area’, the number of questions to be set should be 
specified. 

An illustration of aTwo Dimensional Chart for a Pre-University Exami¬ 
nation in Biological Science is given in Table 1. Each box framed objec¬ 
tive—content wise includes the number of short answer questions (A short 
answerquestion is one which can be answered briefly in specified number 
of sentences). 

The Two Dimensional Chart like the one above, would ensure better 
coverage of the prescribed syllabus (this would result in the CONTENT 
VALIDITY of the examination). 

Coverage of the instructional objectives, (This would result in the 
improvement of the constructive validity of the exam.ination to some 
extent and pave a way for planning for improved teaching—learning which 
would ultimately improve university standards). 

Increase in the number of questions. (This will resultinthe improve¬ 
ment of the reliability of examination, as the longer the test, the more 
reliable it is). 

In the above illustration, the form ofthe questions envisaged is ofthe 
Short Answer type. But it can be of the objective type too. Thirty good 
Multiple choice type of test-items can also be very well prepared. The 
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essay form of question can also be used. In that case 6 to 8 essay type of 
questions can be set each having 2 or 3 sub-questions based on any of the 
instructional objectives listed horizontally in the Blue Print. 

TABLE 1 

Instructional Objectives 

Under- Fami- Ability to Ability to Total 

Content aspects standing liarity interpret apply questions 
of with data principle 

important depend- 
facts & able 

principles sources 

of infor¬ 
mation 

A. Function of 
Human Organs. 

(1) Nutrition 1 1 

(2) Digestion 1 — 

(3) Circulation 1 — 

(4) Respiration 1 — 

(5) Reproduction 1 1 

B. Uses of Plant 
and Animal 
Resources 

(1) Energy rela- 1 1 

tionships 

(2) Environmen- 1 1 

tal factors 
conditioning 
plant and 
animal growth 

(3) Heredity & 1 — 

Genetics 

(4) Land 1 1 

Utilisation 

C. Evolution and 1 1 

Development 

Total : 10 6 7 7 30 


SOME important DECISIONS 

The planning of a question paper would also involve some important 
decisions. Inmost cases the question paper will be ofthree hours duration. 
This is because question papers in university examinations are each usually • 
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of three hours duration. A three-hour question paper has become almost 
a rule in universi ty examinations, because the pattern of questions is, by and 
large, of the essay type and a bulky syllabus is to be covered. It is possible 
to reduce the lengt*! of time of university question papers to 2 hours, or 
even less than that, if short answer type or objective type questions, which 
can cover larger content area in a shorter period time, are adopted. 

Another important decision, which has powerful implications for the 
improvement of university standards is the determination of relative weight- 
age to be given to ‘Memory Questions’, Knowledge Questions, Application 
Questions and Critical Reasoning Testing Question. In a good programme 
of teaching, recall and rote memorisation of isolated bits of information 
should have least weightage. Questions testing really understanding and 
knowledge should have half the weightage, and the remainingportion of 
weightage should go to questions of the Application, Interpretation, Cri¬ 
tical Reasoning and Appreciation type. If this kind of a scheme of weight- 
jgc is used in framing university examination questions, it will have 
stimulating and motivating effects on university teachers and students. 
Usually, university teachers as well as students plan their respective work 
keeping an eye on what is asked in university examinations. If university 
question papers include penetrative questionsinvolvingchallenging intellec¬ 
tual tasks, they would also tend to attune their teaching-learning techniques 
and habits to meet those demands. This is because, university examina¬ 
tions reign supreme and powerfully in the academic realm. Of course, 
this should not be the case. But the present situation can be exploited to 
improve teaching-learning in colleges and university departments. 

The third important decision would pertain to distribution of marks 
in different questions. All questions cannot carry the same number of 
marks. The weightage in marks would depend upon the importance of the 
instructional objective and of the content area. Questions of Application 
or Critical reasoning should have more marks allocated to them than of 
simple recall or knowledge types. Similarly, some content area will receive 
more marks than others which are of less importance. 

The fourth important decision would relate to the question w'hether 
options are to be provided or not. This is a difficult decision because 
options have been in use for a long time, and students as well as teachers 
are so much accustomed to the use of optional questions in examinations, 
so much so, that if options are not provided in University Examinations, it 
might provoke student wrath and agitation. Two wrong beliefs or mis¬ 
conceptions prevail regarding the use of optional questions: firstly, 
options give confidence to students when attempting a Question Paper and 
secondly paper-setters are able to cover more adequately, the syllabus 
through the system of options. 

However, the provision of optional questions in a Question Paper 
makes examination less valid, reliable and fair. It is almost impossible 
to frame or select a number of questions of equal difficulty level, involving 
thejame amount oftime andcalling forth the joine mental effort on the part 
of the examinees. “Even assuming that two questions have the same 
difficulty value and take the same amount oftime in answering, it is neces¬ 
sary to prove that these questions can be valued with reference to the same 
standard by the same examiner as well as by different examiners”. Thus 
the provision of optional questions is not scientific. However, optional 
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questions caiiuot be done away with immediately. That would not be a 
good strategy for examination reform. As a transitional measure, options 
should be provided internally, i. e. for individual questions and not on an 
overall basis with the format “Attempt any fire questions” And that loo, 
for introducing questions involving cirtical thinking and application abi¬ 
lities. 

These are the four inherent imporianl decisions in the planning of a 
good Question Paper. 

framing of individual qufstions 

The framing of individual qucsiiuns elfecli\ely forms the second im¬ 
portant constituent of belter university examinations. Each question 
should receive utmost care and time from the paper-seller. 

The following are some ofthe importani erileria which each queslion 
should satisfy individually : 

1. A question should be sharply based, as far as possible, on the 
instructional objective to be evaluated as well as the eonlent area 
of the prescribed syllabus. 

2. It should make use of the testing situaiion that is dill'crenl from 
what was used by the teacher while teaching and what is given 
in the Text book and other materials. It should be a ftew sit nation 

3. The wording should be so clear, unambiguous and precise that a 
question would mean the same thing to the paper-seller, to the 
candidate and to the examiner. 

4. Thelanguageshouldbesimpleandstraight Ibrwardso thaiasiudeni 
with average intelligence and achievement should have no difli- 
culty in understanding what the question asks for. 

5. It should not beloo difficultsoihat none ora verv few orihecxami- 
nces can answer it correctly, or too easy for all the examinees to 
answer it correctly. It should be able to discriminate between 
those groups of students who 'know' and those who ‘do not 
know'. 

6. Individual questions should have varying difficulty level from 'easy' 
to ‘quite difficult’. .About 50 per cent of the questions should K 
such as can reasonably be expected to be attempted by average achie¬ 
vers (students): a few—say about 20 percent should be simpler than 
that (which should be placed in the beginning of the order of ques¬ 
tions in the Question Paper in order to encourage and motivate the 
examinees) and about 30 per cent should be of gradual increasing 
difficulty so as to screen out the able and talented from the entire 
group of examinees. 

7. The directions prefacing each question should be also simple, precise 
and unambiguous. 

8. The scope and length of each question should be clearly indicated 
by providing directions, such as “answer in not more than 400 
words”. 
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CONCLUSION 


Examinations can be made an ally of good education. For that the 
processes and procedures associated with examinations should be refined 
and made more scientific. While it is very necessary to approach exami¬ 
nation reform fromthe larger stand-point of making our educational system 
better able to perform its function of developing the students by giving them, 
increased knowledge, skills, abilities, interests, attitudes and adjustments. 
iL is equally necessary to enrich and improve the evaluation tools. It is 
said that 1 out of every 4 failures in university examinations in India is due 
10 the imperfect, unscientific and slip-shod way in which the examinations 
arc planned, constructed and administered. If wc expect every teacher to 
tench well, we should also expect every teacher to frame a good Question 
Paper and write cITectivc individual questions. This would require in-ser- 
\iee education of oiir college and university tcaehers. The University 
Grants Commission should assist individual universities to organise evalua¬ 
tion workshops for its teachers to train them in fram.ing better question 
papers and writing effective questions. If this is done, it will strengthen the 
evaniination reform movement at the grass root level. 
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3c ucationa' Testing: Relevance to 
India 

A. EDWIN HARPER, JR. 


Four years ago the author had the privilege of visiting psychologists aiul 
educators in a half-dozen East and South Asian countries. He found that 
in the fields ofeducational and vocational guidance, and in the dcvciopmciu 
of aptitude ability, andachievement tests, wein Indiaare, by a wide margin, 
the leader in this part of the world. And yel in what we call “examinalioii 
reform’’—which, in many ways, is an applied aspect of the specialities men¬ 
tioned above—wein Indiaare the most backward of all. We have the know¬ 
ledge and ability for good educational testing. Why has it not been ap¬ 
plied? 

The use of examinations for selections was an indention of the Chinese, 
more than two thousand years ago. But it was not until the beginning of 
the twentieth century that scientific thinking and methods began to be ap¬ 
plied to the assessment of human intelligence. The first modern individual 
intelligence tests began in France about 1905. The group intelligence lest, 
for large-scale evaluation, received its first large development under the 
pressures of the recruitment drives in America in the First World War. 
Shortly after that it came to be realized that the same objective methods 
which were used to assess intelligence could also be applied to measuring 
scholastic aptitude, ability and achievement. (Those who think that’‘objec¬ 
tive examinations” measure only memory and not thinking should ponder 
their origin—surely intelligence tests are not tests of “mere memory”.) In 
1942, through a combination of circumstances, the College Entrance Exami¬ 
nation Board in theU.S.A. began to shift to purely objective type examina' 
tions and other forms of modern educational testing. The results were dra¬ 
matic. Alden Dunham, formerly Director of Admissions of Princeton Uni¬ 
versity; italicizes this sentence in a recent article on college admissions: 
'‘There is no doubt whatsoever that the current form of the College Board tests 



has been a major factor in promoting social mobility in the United States."^ 
The older Board examinations had been much like those of most Indian 
matriculation boards. They were essay-type exams. The students from 
superior schools were specifically coached on how to pass these exams— 
those from ordinary schools usually failed them. Furthermore, students 
from upper socio-economic levels, who had been brought up by educated 
parents, had the linguistic fluencynecessary to do well in the traditional essay- 
type exams—those from poor and uneducated homes did not. But when 
“writing your answer in good English” was replaced by “thinking and choos¬ 
ing the best answer from among those listed”, this linguistic handicap was 
largely undercut. (This is not to deny the importance of correct language— 
but that should be measured in examinations of language, not of mathe¬ 
matics or economics.) It was found—much to the surprise of many—that 
there were very many able students of physics, chemistry, history, civics, 
who Were able to show their ability on the new-type tests as they had not 
been able to on the old. In a word, if we believe that educational oppor¬ 
tunity (and university admissions) should be based on mental ability rather 
than on socio-economic status, the new-type tests have more than demons¬ 
trated their value. 

There were other advantages as well. Instead of spending, say, 10% 
of his time thinking and 90 % of it frantically trying to write down his thou¬ 
ghts, the student now spent 90% in thinking and less than 10% in indicating 
The results of his discriminant thinking. (Someone has said, though it is 
an exaggeration of course, that the traditional essay-type test is primarily a 
measure of physical stantina.) Thus the efficiency of examinations was 
greatly increased, and instead of taking several weeks the American matri¬ 
culation examination is now completed in a single day. At the same time, 
its validity —as measured against subsequent university marks—has subs¬ 
tantially increa.sed. More validity in less time—and the time formerly wast¬ 
ed in examining can now go into educating which (rather than examining) 
should be considered the prime purpose of the university. (Is it? Some¬ 
one has said, “India has no educational system—onlv an examination sys¬ 
tem.”) 

We do not mean to impi) that in America only so-called objective 
te^ts are used. All types of examination questions have their place. How¬ 
ever in large-scale public cxantinalions. in England as well as in America, 
(lie efficiency of modern educational testing methods is more and more 
considered to outweigh whatever limited advantages the traditional exami¬ 
nation may be thought to have. 

What are these "objective-type” tests? Most Indian students have at 
One time or another studied WortLsworlh's “The World is Too Much With 
Us.” Try this question : from among the possible answers given, you are 
to select the one best answer. 

In the line "The World is too much with us : late and soon”, “the 

world" refers to ; 

A. The earth on which we live, 

B. The other countries of the world. 

I. E. Alden Dunham, “A Rcvolulion in Admissions". Primehm Alumni Weekly 
Nov. 15, 1966. 
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C. Heaven. 

D. A spirit of materialism. 

This question appeared in an English examination in our college in India. 
We did a statistical analysis of the results (one of the incidental advantages 
of this type of exam), and found that almost all of the best students (as 
judged by their total marks on 120 questions answered in two hours) had 
selected answer D. Of the weak students, on the other hand, more than 
twice as many selected A as D. The weak students had only read the words 
literally and so they chose the literal answers. Only the best students had 
understood the poem as a Whole, and applied that understanding to their 
interpretation of this isolated line. What is required to pass this question 
is not just book knowledge of English poetry—it is poetic understanding 
and appreciation. 

It is obvious that objective-type questions can measure more than 
mere memory. But how about the possibility that student.s answer correct¬ 
ly just by guessing? Some students, of course, do get the answer by guessing. 
But this proportion is not significant. If all students only guessed, then 1,4 
would guess right and 3,4 would guess wrong, just by chance. Thus the 
maximum that any student can get just by guessing i.s. on the average. 2.v;',,. 
so a student vvho knows nothing cannot possibly pass. In practice, how¬ 
ever. students guess on only a few questions. Since only 14 of these few 
will be ‘'right''just by chance, this has little elTeci on their marks. Further¬ 
more, even this effect can be largely eliminated by a simple statistical cm- 
rection. This correction formula reduces the marks on the guessed ques 
tions to zero.'^ 

Many of the other objections often raised to objective-type examination' 
have equally simple technical answers. And incidentally, the superiority oi 
objective over traditional examinations does not lie primarily in the mecha¬ 
nical objectivity with which they can be marked. It lies rather, in the fad 
that many more questions can be asked in a given period of time, that the 
entire course (rather than just parts of it) can be covered, that the studem 
can be forced to think, judge, di.scriminate, rather than just spout thing' 
memorized from a book. Nor is the examiner s judgement eliminatcil 
The writing of a large number of questions, and selecting the best for lla 
test, requires a great deal of highly ski lied judgement. The only difference i; 
this : This judgement is applied to examination-writing, and therel'oi> 
affects all candidates equally—^whereas in essay-exam marking, judgenteni 


2. Uivide ihc number of questions answered wrong b> one levs than the number o 
choices per qiiesiion, and sublracl thk from the number righl. IT there are five sugBcsU’' 
answers to every qiicslion, one-qiiarler of ihc number wrong is .nibiraclcd from ihe nunv 
ber right. Suppose lliai, out of 100 questions, a suident knows Ihc answers to 60, and 
gucs.scs ihe remaining 40. OT the 40 guessed, the average .suident would get J'5, or t 
right, and ihe rest wrong. 


Answci's known 

Right 

60 

Wrong 

0 


Answers guessed 

8 

32 

(loud gues.scd—40 

■foriM.s 

68 

32 


.Subtract 1/4 ul' Wrong—.12,4 
CORRECTED SCORE 

__g 

60 


- answer,' knowi 
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varies from tinw to time, and is applied differently to different candidates in 
the same examination. 

Another wide-spread belief among those who do not yet understand 
modern testing methods is that objective-type examinations may be relevant 
to elementary school education, and may possibly be useful in some high 
school subjects, but have no applicability to higher education. The facts 
are quite to the contrary. The use of objective examinations at the univer¬ 
sity level is spreading steadily in both England and America, and where 
numbers are large they are not only used for admission to postsgraduate 
studies, but even, in such fields as medicine._and law, for certification at the 
highest postgraduate levels. In India they have been quite successfully 
used in selecting M.A. and M.Sc. graduates for further study. 

RLLLVANCE TO INDIA 

All that we have said thus far may sound radically new to many of our 
readers. Yet there have been close to a hundred research articles on this 
subject published in India already ! (See References at the end of this 
chapter ) A great deal of e.vpenmen'alion has been carried out, and theapp- 
licability of these scientific methods of educational testing to Indian condi- 
lions has been proved again and again. The tragedy, perhaps is that most 
ofihis research is buried in technical journals of limited circulation. The 
use which has been made of modern educational testing methods in India 
isapparently quite unknown to the vast majority of college professors in India. 

Besides assessing classroom achievement, there are three major uses of 
educational tests which have been used successfully in India : Selection, 
placement, and guidance. A fourth may soon be added, maintenance of 
-iiandards. 

St 11 Cl ION 

It IS time that we begin to substitute selective admission for selective 
graduation^. When educational facilities are limited, every potential failure 
who is admitted implies that a potentially successful student has been denied 
:i seat in the university. Not only are human beings thus being deprived of 
their potential for full development, but also ihe money spent on educating 
it student who fails his finals may be largely wasted. The problem, of course. 
IS how to predict how well a student will do in hi.s course. Traditional me¬ 
thods—high school board marks, interv'ievvs—have often proved notoriously 
unreliable. (The failure rate in universities would not be nearly so high if 
these marks actually predicted well.) Even where the marks of some boards 
tlo seem to be more reliable, institutions are faced with selecting students 
who have appeared under several different boards, with no commonly 
itcceptcd standard. Thus many institutions now conduct their own 
tidinission tests. However all too often these e.xaininations are of the same 
"Id inefficient, expensive, unreliable type as the higher secondary boards 
tire using. 

It is here that modern educational testing methods can have their most 
tiselul impact, (a) They can easily reduce three days of examinations to a 

1 am indebted to Dr. K. K. Anand, of I.I.M. Ahmedabad, for this partieiilarly feliei- 
lous phrase. 
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single day of five or six hours, and several weeks of marking examinations to 
a day or two. (6) At the same time, they can significantly increase the relia¬ 
bility and validity of the selection process. 

Two types of tests are commonly used for modern selection methods, 
(a) Scholastic or academic aptitude tests. Which are related to what used to 
be called “intelligence tests”. But their purpose is more specific. They 
attempt to measure the degree of development of those abilities which are 
most basic for higher education : the ability to understand, use, and reason 
with Words, and the ability to think in quantitative terms, (b) Achievement 
or attainment tests, which attempt to measure knowledge, understanding, 
thinking, problem solving, in specific academic fields. Using multiple 
choice questions, a test with 50 questions to be answered in 45 minutes will 
often cover more than two three-hour papers of the traditional type, in the 
same subject. But even in achievement testing, the trend is away from 
questions based on a specific curriculum. Rather, the most modern of 
these tests attempt to measure developed abilities to think, reason, under¬ 
stand in a particular academic discipline, rather than just knowledge and 
understanding of a specified body of facts. And it is because of this that 
they are increasingly successful in predicting/utHrc achievement—which, 
after all, is the crux of the selection problem. 

Based on both foreign and Indian research experience, these things 
we know : (a) That modern educational tests (both aptitude and achieve¬ 
ment) are better selection instruments than the traditional examination 
methods; (Z>) that when aptitude tests are combined with school marks (or 
rank in class), the combination produces better selections than either alone; 
(c) that on the average, objective-type examinations are approximately six 
times as efficient as the traditional type; (d) andthat the validity of any 
selection instrument ormethod will vary from institution to institution, and 
even from year to year in the same institution. 

To document these important statements fully Would require a book; 
but within the space of a chapter they can atleast be illustrated, from Indian 
research and experience. 

Modern educational tests can improre the selection of students for higher 
studies. Vellore Christian Medical College has perhaps had longer expe¬ 
rience with this type oftestingthan any other institution of higher educa¬ 
tion in India. In the initial years, the shift to the new methods for select¬ 
ing students resulted in a 26 % reduction in the number of .years lost (through 
detainments) per hundred students. The figures show that “with a given 
amount of facilities and finance, a little better than four more students per 
hundred are being given a medical education since these modern selection 
methods were substituted for the older oncs.’"^ Similarly, there Was a 
27% reduction in the number of papers failed per student. The imp¬ 
rovement was primarily in the quality of II and 111 Division candidates ad¬ 
mitted but even the number of Intermediate First Divisioners who later did 
poorly was reduced. 

T. P. Lele and his colleagues administered a University Entrance Test 


4. Carman, Naomi H., Paul, Joy C., Harper, A. Edwin, Jr., Das Cupla B., and Sangal, 
S. P. “A Note on (he Validity of A Medical College Selection Programme,” Sankhya 
The Indian Journal of Statistics, Series B, 1962, 223-244. 
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at Baroda. A year later the correlation® of these marks with First Year 
Science results was .68, with Arts it was .34, and with General Science it 
was . 74. The last of these is near the level at which two different intelli¬ 
gence tests will correlate with each other, and thus indicates a very good 
level of prediction (and accuracy of selection) indeed. 

Several institutions (Baroda, Mysore, Agra, Sagar) have developed 
teacher aptitude tests, which correlate with later results at around .30. TTie 
selection tests usedforthe TrainingCourseofthe Bengal Library Association 
predict later examination results with a coefficient of correlation of .62, 
while the selection tests for the Indian Statistical Institute’s M. Stat course 
have correlated as high as .72 with later results. The Indian Institute of 
Management, Ahmedabad, found that a Scholastic Aptitude Test of Quanti¬ 
tative Reasoning alone was a better predictor of later marks than High 
School Division, Pre-University Division, Degree Division, and their own 
Interview Ratings. I.I.M. Calcutta had similar results with a more extensive 
battery of selection tests. 

Prediction of later marks (and hence selection) is improved when various 
measures are combined. Generally, the combination of both objective edu¬ 
cational tests (aptitude and achievement) with previous academic record 
(or rank in class) does a much better job than either alone. The Institute 
of Vocational Guidance and Select! on (Government of Maharashtra)studied 
a medical aptitude test. The correlation was .49 with first year marks; 
but when Intermediate Division was combined with the selection test results, 
the correlation With first year marks was raised to . 57. In 1955, the Indian 
Statistical Institute in Calcutta admitted only First Division M.Sc.s in mathe¬ 
matics or First Division B.Sc.s in statistics to its advanced course. In 1956, 
when admissions were l ased on both aptitude tests and previous Divisions, 
one-third of those selected had been Second and even Third Divisioners. 
How well did they do? Of the 1955 group, which was made up of First 
Divisioners only 46% did well on their first important examination; of the 
1956 group, 74% did well. Thus the addition of educational tests (both 
aptitude and achievement) allowed the Institute to select Second and Third 
Divisioners who were of better quality than the First Divisioners taken on 
academic record alone. At the Vellore Christian Medical College, not only 
was the combination of aptitude tests with previous Division better than 
either alone, but the addition of a three-day interview and personality test¬ 
ing procedure raised the correlation from .55 to .63. Incidentally, this cor¬ 
relation was with the final resultsyji'e j't’orj /otcr, not just with first year 
exams; and it was with the rating, after five years of contact, of how good a 
doctor his or her teachers thought each student was going to be.® 

5. The “coefficient of correlation” is used here as a measure of the relationship between 
selection scores and final marks. The detailed interpretation of [his coefficient is a techni¬ 
cal matter beyond the scope of this paper. (Readers not familiar with it may refer to any 
textbook on educational and psychological statistics.) Suffice it to say that the coefficient 
varies from 0 (no relationship at all) to 1 -00 (a perfect relationship). 

6. It is probably impossible to measure how good a doctor each student actually be¬ 
comes. Brilliant student A is offered a foreign scholarship for post-graduate studies, but 
he refuses it because he wants to serve the poor in India’s villages. The scholarship is 
then offered to student B, who accepts, finally settles abroad, and becomes a World-famcus 
surgeon, while A's name remains unknown beyond his district hospital. Which is most 
“successful"? 
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Objective measures of achievement (knowkdge, ability, thinking, 
are approximately 6 times as efficknt as traditional exaimnations. This 
figure of “six times as efficiejit” is, of course, only a very rough approxi¬ 
mation. The degree to which efficiency is improved depends on mam 
complex factors, such as subject matter, type of questions, and level of edu¬ 
cation, Perhaps a range of three or four up to 10 or 12 migh t be more dcs - 
criptive. But as an average, six seems as accurate as any. 

The writer first heard this particular figure 18 years ago from Prof. 
P.C. Mahalanobis, India’s world-famous statistician. Prof. MahaJanobis 
had experimented with objective examinations many years earlier, when he 
Was teaching Physics at Presidency College in Calcutta, and had found them 
to be approximately six times as efficient as traditional examinations. The 
writer also heard an American expert state that it would take 18 to 24 hours 
of traditional essay-type English examinations to reach the reliability of a 
single three-hour objective examination in that subject—a ratio of about 
6 or 8 to one. Many other studies have compared the two types, both in 
terms of increased reliability and validity, and also in terms of increased 
coverage. In a brilliant paper a professor of pathology in an American medi¬ 
cal college, Dr. Robert A. Moore, translated an actual essay-type question 
into a series of objective questions. He showed in detail how everything 
covered by this single traditional-type medical college examination question 
in pathology—knowledge, recognition of differences, description of changes, 
understanding of mechanisms—can be covered in 17 objective-type ques¬ 
tions., “If we assume that this one example is an average, this means that 
with 17 times five, or 85 objective questions, the same niaterial can be covered 
as in a five-question essay examination. In fact, the usual objective exami¬ 
nation of two-to three-hour duration contains 200 to 300 items which would 
correspond with 12 to 18 essay questions. Thus, the objective examination 
can cover a broader spectrum of knowledge than the essay examination in 
the same time period and, therefore, is the examination of choice when this 
is desired.’’? In India, similar translations of essay to objective questions 
have been done by Vidya Sagar Misra of Gauhati University, and others. 

Several studies, including at least one done in India, have shown that 
even essay-writing ability—as measured by a series of essays written in col¬ 
lege—can be predicted better with a,half-hour objective test of “knowledge 
of English usage’’than with an essay-writing examination of the same length. 
The Indian study, done in 1955 When English was still a medium of instruc¬ 
tion, merely asked students to recognize errors in English. For example, 
in the following sentences, w'rite in the brackets the number of the section 
in which an error occurs: 

X. The box/which he maded/broke. NO ERROR ( ) 

12 3 4 

Y. The man/Wcnt Walking/in the woods, NO ERROR ( ) 

12 3 4 

The answer to the first item is “2” while for the second, which is a correct 
sentence, it is “4”. There were other types of questions, also, requiring the 
student to select the best from several alternative possible corrections. 

So far. We have discussed efficiency basically in terms of better (more 

7. Moore, Robert A., ‘'Method.s of Examining Student.s in Medicine”. Journal of 
Medical Education, January, 1954, 
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accurate and more complete) measurement per unit of time. But it shows 
up in other, more qualitative Ways also. Studies in India (particularly those 
of Dr, H. J. Taylor) suggest that perhaps 25% of all those who “fail” in our 
public examinations fail because of the unreliability of the examinations, 
not because of actual lack of merit. Thus it is often the examination sys¬ 
tem, not the unlucky candidate, which has actually “failed”. Objective- 
type tests can be used to reduce the amount of time taken in examining 
(which is What is done in selection testing). However, if we are willing to 
continue examinations for the same length of time as presently, then the use 
of objective-type questions could greatly reduce the number of candidates 
unfairly branded as “failures”. 

It should be added parenthetically that very few experts Would scrap 
the present form of questions completely. Rather, they would advise a 
mixed examination, containing both multiple-choice and improved tradi¬ 
tional-type questions. Each type can then be used to assess the particular 
abilities for which it is most relevant, thus working towards a much more 
balanced whole. 

Although our discussion is about the use of modern educational tests 
which are externally prepared, perhaps a digression on the use of these 
methods for teacher made tests in the classroom is not entirely irrelevant. 

The simplicity with which objective examinations can be marked m.akes 
them very useful for more frequent unit tests in the classroom. (Once pre¬ 
pared, they can be used repeatedly. Students should be allowed to look 
over their mistakes, but not to keep the papers. They should be studying 
the course, not old examinations). More frequent testing leads to better 
study habits. Tt has also been shown to lead to better final exam results. 
Students who have learned once for a unit test, a second time fora Terminal, 
and had a third review for a Final have a much better grasp of the course 
than those who have only crammed once. 

There is a wide recognition of the need for closer student-teacher un¬ 
derstanding. Yet any talk of reducing teacher-student ratios is probably 
unrealistic, given the pressure of rising population and rising educational 
aspirations. Objective tests do, however, provide at least some amelioration 
in this situation, (a) When handed back for study, they provide each 
individual student with a detailed picture of what his errors in thinking 
and understanding are—a far greater degree of individual help than is ever 
possible for a busy teacher using traditional-type examinations. (6) If the 
teacher (or the college examinations office) tabulates what questions were 
missed by large number of students he gets a very clear feed-back as to 
what the strengths and weaknesses of his owm teaching have been. What 
needs further review, etc. Thus the objective test serves as an instrument of 
two-way communication in a far more efficient manner than is possible with 
the traditional examination. 

The validity of an educational selection test or method will var}' from 
institution to institution, and even from year to year in the same institution. 
In the U.S.A., where objective tests are Widely used for selection, the same 
scholastic aptitude test may show validities varying from .85 to zero in vari¬ 
ous colleges and universities. This may reflect different concepts of educa¬ 
tion, and therefore different types of ability required for success in different 
institutions. More surprisingly, several studies in India have shown that 
even in the same institution, the validity of a selection method may 
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vary from year to year in one case the range Was from . 75 to zero. 
Some of this variation may be the function of the particular group of stu¬ 
dents admitted in a particuJar year. However, it is at least possible that 
much of it is due more to the unreliability of college and university exami¬ 
nations than to any defect inherent in the selection instrument. In one 
case, an objective examination was used as the “test examination” in one 
paper iji several high schools. Shortly thereafter, these students appeared 
for the Board examination in that paper. The correlations between the same 
objective examination and the same Board examination ranged from 
+ .82 to—.25. The reliability of the objective examination Was statisti¬ 
cally determined to be quite adequate. In the Board examination, the ans- 
werbooks from different high schools probably Went to different exa¬ 
miners. 

The point of this section, of course, is that no final decision about 
any method of selecting students should be made on a single experiment. 
Repeated research is necessary—both on traditional selection methods, and 
on the use of improved educational tests—before there can be any final ver¬ 
dict. There are enough data buried in most Registrars’ offices to show how 
valid traditional selection methods have or have not been. Statistical stu¬ 
dies are needed of these data. It is against this background that We can 
asses the possible contribution of educational tests, to better selection of 
students. 

PLACEMENT 

Within certain limits, there is a great deal to be said for grouping stu¬ 
dents accordingtoability and level of previous traini.ng. In an English class, 
for example, putting beginners with advanced students can result in consider¬ 
able waste. The faster students are held back, often bored, and certainly not 
able to develop to the fullest—^while the pace may still be too fast for the 
weakest students who, not even reaching the first rung of the ladder,may end 
up learning virtually nothing. The same is true in other subjects. Object¬ 
ive achievement tests form a quick and efficient way of finding out the level 
of understanding a particular student has reached in the subject. Wilson 
College, in Bombay, uses an English Placement Test to select its students 
for an intensive English course. Isabella Thoburn College, Iiucknow, has 
used tests in science subjects in this way for several years. A wider use of 
educational tests for placement is overdue. 

maintenance of standards 

The external examination system in India is supposed to produce uni¬ 
form standards—but in practice, we all know that it does not. Certain 
universities are known to be better than others, but there is really no direct 
way in which they can be compared. One problem is that, with the tradi¬ 
tional examination system, statements about relative standards ultimately 
rest solely on human judgement. And human judgement is notoriously 
fallible. There is good reason to believe that even Within a single examin¬ 
ing body, the wide Variation in pass percentage from year to year is more 
a reflection of the variability of examiners’ judgements than of any actual 
variation in ability of the candidates examined. 
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Objective tests and examinations provide an obvious answer to this 
problem. Human judgement enters heavily into the preparation of the exa¬ 
mination, but the marking and assessment are then completely objective. 
Thus the same examination could be administered in a large number of 
universities, and yet be marked with a completely uniform standard. 
What is more likely, however, is the use of standardized tests by teachers or 
department heads as a means of assessing their own work, and, if neces¬ 
sary, raising their teaching standards to meet a more general norm. 

To maintain standards over a period of years in the same institution 
the same tests cannot, of course, Ik repeated. Students would learn the 
answers, and thus get progressively better results. However again statistics, 
that handmaiden of modern psychology and educational measurement, 
comes to our rescue. We have already mentioned that even used examina¬ 
tions should not be published—students should study the course, not old 
examination questions. Thus out of 200 questions in an examination, it 
is safe to repeat, say, 20 of them the next year. When we compound the 
low probability of a student having heard about these particular 20 ques¬ 
tions, with the less than perfect probability that he has heard them exactly 
correctly and has heard the correct answer to each of them, we can see that 
the influence of such repetition on any student’s mark is likely to be negligi¬ 
ble. Statistical manipulation of the results of these 20 questions, however, 
make it possible to mark the new examination to almost exactly the same 
stan^rd as the examination of the previous year. Over a period of years 
this norm can be maintained. In 1982 we can still be marking students 
according to the same norm as in 1970. With present traditional examina¬ 
tion methods, this is impossible. 

GUIDANCE 

At the higher secondary level, educational tests, both of aptitude and 
(to a lesser extent) of achievement, are widely used in India to guide students 
in making correct educational and vocational choices. At present, only 
examination marks are used to provide such guidance at college and univer¬ 
sity levels in India. Since the reliability of examination marks is often 
low, they provide only a highly fallible guide. The provision of better 
testing instruments for guidance of students at the university level seems to 
be a field which is now ripe for development. 

THE MISUSE OF EDUCATIONAL TESTS 

Educational tests of the types we have been discussing are tools—they 
are no panacea. If they are used mechanically, they may only serve to 
increase bureaucratic tyranny. Educational tests—and examination marks, 
also—should be used as aids to judgements, never as final answers. They 
must be used along with other tools, measures, methods, and assessments, 
never alone or in isolation. But properly used, educational tests can greatly 
enhance human values in a democracy. They can help to uncover abilities 
which may otherwise escape notice because human judgement is influenced 
(unconsciously, often) by such irrelevant factors as sex, creed, or race. 
They can help to equalize educational opportunity. Their introduction 
into the selection process can often give a second chance to a student who 
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has done poorJy in an examination because of illness, anxiety, poor verbal 
fluency, the unreliability of examiners, or other irrelevant factors. 

Research is needed on all methods of selection—educational tests, 
interviews, traditional examination marks, etc,—and they should be used 
only in the light of such research findings, not on the basis of arbitrary 
assumptions as to their reliability and validity. 

A PROPOSAL 

The best tests are those which are written by subject-matter experts, 
with the guidance and editorial assistance of an expert in educational mea¬ 
surement. Any university, and even a small college, can set up an examina¬ 
tions office to promote better educational testing. However, the pooling 
of knowledge and facilities has many advantages, increasing the quality of 
the tests and examinations while at the same time reducing their per student 
cost. 

What is needed is an Inter-University Cooperative Testing Service. 
Such an organization would be a voluntary association, serving within a 
single linguistic area. It would provide three types of services: (1) It would 
operate “secure” selection programmes, such as are now used by the Indian 
Institute of Management, Calcutta, the Vellore Christian Medical College, 
etc. By “secure” we mean that all testing materials remain confidential, and 
are the property of the lUCTS, so that they may be used again without leak¬ 
age. The lUCTS would send to all candidates, ahead of time, a booklet des¬ 
cribing the tests, giving sample questions, telling how to prepare. To keep 
the actual testing materials confidential, the lUCTS would set up testing 
centres, send out the materials, have them returned formarking and scaling. 
The results would then be sent to the colleges or institutions. Which would be 
free to make use of them in any way that they wished in deciding on admis¬ 
sions. (2) The lUCTS would also develop and standardize other tests, which 
would be sold to any qualified user. While these obviously could not be 
used for selection (where any “leakage” invalidates a test), they would be 
very useful for guidance, placement, and even for informal “maintenance of 
standards” use. In the latter, a teacher of, say, psychology, would adminis¬ 
ter a nationally (or regionally) standardized test to his own class, to find out 
how his teaching compares with that of other universities. 

Both of the above services are offered by such organizations abroad. 
For the third service, there is little precedent, as it is related to the peculiar 
situation in India where admissions must be carried out within only a week 
or two available between the time higher secondary results are published, 
and university opening dates. (3) The lUCTS would provide selection 
testing materials for local administration, scoring,and interpretation by the 
college or university buying the service. New tests would have to be provid¬ 
ed each year, because even with the best efforts the tests would probably 
“leak” after use. Detailed instructions would have to be provided so that 
scoring and interpretation could be done by college and university teachers 
and administrators with no background in educational measurement. It 
seems probable that, as the growth of population and of educational aspi¬ 
rations begin to make selective admissions a necessity, it is this third service 
which Would be most widely used. 

Such a cooperative testing service can build on the experience we already 
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have in India, as well as the experience abroad. Through it, the potential 
benefits of modern educational testing can be made available to every uni¬ 
versity, college, and technical institution in India. 
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3xamination Design 

J. E, JAYASURIYA 


When a student has been exposed to an educational programme, it becom¬ 
es necessary to assess the extent to which he has acquired the knowledge 
and the understanding which the programme was designed to give. Educa¬ 
tors throughout the ageshave grappled with the problem of how best to make 
such assessments. Examinations in fact evolved in a somewhat different 
context, the beginnings being in China over 1,600 years ago when oral 
examinations were used in the competition for entry into the Chinese 
Imperial Service. Essentially they were elimination competitions consist¬ 
ing of a number of eliminating rounds designed to reduce the number of 
applicants to the number of available positions. It Was incidental to this 
objectivethat degrees were awarded to those who survived certain eliminat¬ 
ing rounds, but in that process examinations also became assessments of 
achievement. 

Obviously, assessments have to be made on the basis of one or more 
overt responses elicited from the student by the examiner. The latter is in 
control of the stimuli, such as questions, which are used to elicit responses 
from the student. In other words, the designing of the examination is 
generally in the hands of the examiner, and it behoves him to use all the 
ingenuity at his command to design an examination that would make efficient 
assessments. In actual fact, there are practical limitations on the exercise 
of his ingenuity. The nature of the subject matter in a particular field of 
study may impose limitations. A more serious limitation, however, is that 
imposed by the sheer weight of numbers receiving education and needing 
assessment. Not only is the ancient method of oral examinations ruled 
out by the weight of numbers,even the Written examination appears to be at 
stake in the future unless it can be assessed by mechanical means. Be that 
as it may, the design of examinations is an undertaking that requires a great 
deal of study and experimentation. 



From the point of view of sampling the subject matter taught in a course, 
an examination consisting of only a small number of questions necessarily 
samples only a relatively restricted number of the topics dealt with in the 
course and leaves out all the other topics included in the course. To in¬ 
crease the number of questions with a view to ensuring a comprehensive 
coverage of the subject matter of the course would entail an inordinate 
length of time for answering the questions, unless the questions can be ans¬ 
wered briefly. In other words, if the answers are to consist of essays, the 
number of questions has to be limited to five or six, thereby making a res¬ 
tricted sampling of the subject matter inevitable. It follows from these 
considerations that if a comprehensive coverage of the subject matter is to 
be aimed at in an examination with a manageable time limit, the number 
of questions has to be large and every question should be such that it can 
be answered without much expenditure of time. 

Let us first consider the following typical designs for examinations. 

A. A small number of questions (e.g. 5) requiring essay type answers. 
Every question has to be answered and the candidate is given no 
choice. 

B. A small number of questions {e.g. 5) requiring essay type answers 
to be selected and answered out of a somewhat larger number of 
questions (e.g. 10) set in the paper. 

From the point of view of sampling the subject matter taught in a course, 
design A is weak in that it severely restricts the number of topics that can 
be examined. A candidate’s performance is being judged by his knowledge 
of a handful of the topics that would have been dealt with in the course. 
Design B certainly samples the subject matter of a course a little moreeffcct- 
ively than design A but it is open to the weakness that unless all the ques¬ 
tions set are of uniform difficulty a candidate's performance would depend 
to some extent on his choice of questions. Empirical research shows that 
if ten questions are set out of which five are to be answered, candidates 
made to answer on a later occasion the five questions different from what 
they answered on the first occasion earn widely different marks on the two 
occasions. In fact, many of them earn on their own selection of questions 
a lower total than what they earn when forced to answer the remaining 
questions on a later occasion. This is clear evidence of the fact that the 
choice of questions determines in an important measure the marks earned 
by a candidate. 

From the point of view of accurate as.se.ssment of the essay type answers 
written by candidate.s, both designs Aand B are open to weaknesses. Em¬ 
pirical research shows that two examiners would seldom agree about the 
mark to be assigned to an essay type answer. An answer which gains a high 
mark in the opinion of one examiner may earn a low mark in the opinion of 
a second examiner, ifthe two examiners were to assess the answer indepen¬ 
dently of each other. As a matter of fact, research has shown that when 
the same examiner is made to assess an answer on two different occasions 
the assessment on the second occasion being made without a knowledge of 
the assessment made on the first occasion, the two assessments could differ 
markedly from each other. In other words, the marks earned by a candidate 
depends not entirely on the quality of his answer but also on the particular 
examiner who assessed it and when. Boredom could, for example, affect 
assessments differentially, making some examiners more liberal and others 
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more strict. The quality oFthe language in which an- essay type answer is 
written appears to influence the assessment to a considerable extent so much 
so that in certain cases the mark earned by a candidate may be determined 
as much by his command over language as by his knowledge of the subject 
matter of the examination. 

To be sure, it cannot be gainsaid that questions requiring essay type 
answers may be quite demanding intellectually, calling for the capacity to 
present a body of information or a point of view or an argument with clarity 
and coherence. But, however valuable the end product that is proposed to 
be assessed, it is clear that the process of assessment is fraught with such 
inconsistencies or inaccuracies as to make the assessment suspect, and there¬ 
fore of very doubtful value. 

Attempts have been made to eschew designs A and B, and to evolve 
other designs. For example, a design that is popular in the United States 
with such examining bodies as the Educational Testing Service at Princeton 
is one in which the examination paper consists of sixty or seventy multiple 
choice questions. From the point of view of sampling the subject matter 
taught in a course, this design has everything to commend in it for it ensu¬ 
res a comprehensive coverage of the subject matter of the course. The 
scoring of the answers hasthe advantage of being objective, as any possible 
differences of opinion about the right answers are considered and elimina¬ 
ted at the stage when the question is constructed. Great skill is called for 
at the item construction stage in order to ensure that the item.s included do 
not require only factual recall but encompass more complex cognitive skills 
as well. In regard to the exclusive use of multiple choice questions, it is a 
mootpoint whether assessment that is limited to finding out whether a per¬ 
son is able to recognise a correct statement when it is presented to him 
along with some incorrect statements, or to discriminate among alternative 
statements presented to him, could ever be sufficiently comprehensive so as 
to give an adequate picture of a person’s attainment. 

Between the essay and the multiple choice (or other strictly objective 
type) questions is a question type that has not received as much attention 
as it deserves. 1 refer to the type of question which concentrates on one 
specific issue at a time and which requires the student to show his know¬ 
ledge or understanding, express a point of view, or state an argument in a 
very short answer composed by him. In other words, the question should 
be such that the student should be able to write out his aiiswer in five or 
six minutes. Experience with this kind of question shows that a very 
high degree of reliability can be achieved in assigning grade or mark to 
the answers. A selection of questions of this type used in an examination 
paper in psychology is given as an appendix. 

Considering that each type of question—essay, objective type (usually 
multiple choice), and short question—has its strengths and weaknesses, it 
is suggested that the examination paper at university examinations should 
be designed so as to include all three question types. A three-hour 
examination paper can, for example, include 

(o) 40 to 45 multiple choice questions to be answered in forty five 
minutes. 

(i) 12 to 15 short questions to be answered in one hour and fifteen 
minutes. 

(c) 3 essay questions to be answered in one hour. 
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Such a combination of question types may serve to make the examination 
a fairer index of achievement than the exclusive use of any one type. 


Appendix 
ExaDiination Paper 
in 

PSYCHOLOGY 

(.Short questions only) 

1. Whal arc the limitaLions of introspection as a method of psychological .study ’ 

2. What is a control group experiment? Discuss one sueh experiment with which you 
are familiar. 

3. What may be some of the consequences of premature toilet training? 

4. According to Piaget, a child docs not develop reversibility of thought until iheage of 
7 or 8. Illustrate what is meant by reversibility of thought. 

5. Distinguish between reinforcement in classical conditioning and in operant condition¬ 
ing. 

fy Explain what is meam by stimulus generalisation. 

7. What docs Maslow mean by the need for self-actualisation? 

8. What is meant by the functional autonomy of motives? 

tj. In Freud's psychoanalytic theory, what important function does the ego serve? 

10. Contrast eoncept formation with memorisation. 

11. What advantages does programmed instruction have over ordinary class leaching? 

12. How does a linear programme differ from abranehing programme? 

13. Why is punishment regarded as an unsatisfactory disciplinary technique? 

14. Enumerate the common mental mechanisms and give a brief account of one of them. 

15. Enumerate the more important factors that have been shown to be associated with 
backwardness. 
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Designing and Planning o; Question 
Papers 

K. K. ROHATGI-MUKHERJEE 


Designing OF a question paper for a given examination is intimately related 
with the objectives of education and also the purpose for which the examina¬ 
tion is to be used eventually. The examinations may be used for (1) grading 
of students, (2) for promotion to the next class, (3) as diagnostic tool to 
discover areas of strength and weaknesses in the students, (4) to judge the 
effectiveness of the teaching methods and to obtain a feed-back, (5) to select 
students for scholarship and talent, (6) for placement in jobs, etc., (7) for 
subtly changing the course in the event of development of new concepts. 
In the system of education (teaching, learning and evaluation) prevailing in 
our country, a single type of examination is expected to serve all these pur¬ 
poses, except no. (5) where special schemes under the National Talent 
Search Programme have been initiated. This is the biggest'fallacy of our 
education system. 

The University education is meant to develop the overall personality 
and bring out hidden talent of a student so that later on he/she becomes 
a responsible citizen of the country. Therefore any course which is planned 
should, not only emphasize the content, but also the qualities that arc desir¬ 
ed to be developed. But in our country the human aspect or behaviour pat¬ 
tern of the student is seldom considered as something to be reckoned 
with. Teaching consists mainly in imparting of information and exami¬ 
nation questions demand nothing but recall of these information. 

The first step in designing a question paper should be to write out the 
specification in the form of two way grid consisting of (1) the subject matter 
of the course and (2) the abilities, in terms of student behaviour, that the 
course is designed to develop. The taxanomy of educational objectives 
have been defined by Dr. Benjamin Bloom and are well known. In general, 
knowledge, comprehension and application aspect receives greater empha¬ 
sis in our teaching programme. The three still higher categories-analysis, 



synthesis and evaluation normally receive much less weightage. Of course 
the weightage for any of these specifics will depend on the level of teaching 
programme. The first three categories of objectives lend themselves to 
objective type questions. Of different kinds of objective type questions, the 
multiple choice type has been found to be most suitable for a valid and re¬ 
liable evaluation. 

Framing of multiple choice type questions is an art and needs consider¬ 
able time and thought. It can serve as a good diagnostic too] with power of 
discrimination at any desired level. It can be made easy or difficult and 
can be designed to evaluate any given educational objectives or course 
content. Above all, because of the short time required to answer such 
questions, large number of question (items) covering all aspects of the course 
can be given. To have the desirable effect and less ambiguity, the items may 
be pre-tested. This is normally done for preparing a standardised test. 
Although the objective type of tests are best suited for diagnostic purposes 
and day to day assessment of teaching methods, they have some disadvan¬ 
tages in the sense that students, do not get the practice of writing a connec¬ 
ted piece of prose and to show any independence of thought. They may 
also encourage guess work. They are fixed response type and do not 
match with modern trend in teaching which is to give greater freedom 
of thinking and response to the students. 

For assessing the higher abilities such, as analysis, synthesis and eva¬ 
luation, essay type of questions may be considered to be more suitable. 
But subjectivity in marking them is a disadvantage when large number of 
students are to be examined. Although this drawback is partially compen¬ 
sated by appointing 3 or 4 examiners, it does not permit good coverage of the 
course. Many options arc allowed to condense the course within the rime 
limit of examination. No valid judgement can be made as regards students 
abilities. Since all questions cannot be equivalent in all respects, one stu¬ 
dent may get a first class for memory and another for comprehension. 
There is no way to include this fact in the examination results. 

A greater flexibility in examination papers can b; achieved by using 
open-ended structured queitions. These type of questions can be immediate¬ 
ly introduced in the prevailing system of examinations in our country. 
The teachers can get the practice of writing such questions by using them in 
class tests. By doing so, they can discover the strength and weaknesses 
of their own teaching method also. The test should parallel the techni¬ 
que of teaching. Since the modern approach is to encourage student parti¬ 
cipation in the class-rooms, this approach should also reflect in the 
examination technique, i.e., by formulating small question-aniiwer type 
of test paper. 

With proper marking scheme, structured questions can be very effect¬ 
ive as a diagnostic tool. They also can be marked objectively. If present¬ 
ed in a programmed sequence, they can judge correlated knowledge and 
understanding. The students do not have to write a detailed account but 
they must answer to the point, in few short sentences. They know exactly 
what is required of them thus eliminating vagueness and ambiguity Inherent 
in essay type questions. 

A complete question paper in any given subject should include all the 
three types of questions, (I) objective or fixed response type, (2) structure or 
short answer type, (3) essay or free response type. The weightage given to 
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any type will depend on the level of teaching as well as the nature of the 
subject i.e., whether chemistry or mathematics or political science or litera¬ 
ture. For a science subject like chemistry following weightage on the forms 
of test is suggested. The weightage may shift towards essay type at higher 
classes. 


Serial 


Types of 

Weightage 

for 3 yrs 

Number 

Forms of questions 

response 

degree cours 




First year 

Final Year 

1 

Objective 

Fixed 

30 

25 

1 

Structured 

Open-ended short 

60 

50 

3. 

Essay 

Free 

10 

25 


It should be pointed out that for this kind of approach to be successful 
in our pattern of examination system where external examination is un¬ 
avoidable at the college level for affiliating universities, the prospectus of the 
university should not only list the topics to be taught in the classes but 
should also indicate the educational objectives of the course. A lest speci¬ 
fication should be sent out to the external examiners. Then only real re¬ 
form in teaching methods can be implemented because examination ques¬ 
tions have great influence in curriculum development and improvement 
of teaching. 

The art of writing multiple choice questions is acquired only by prac¬ 
tice. Therefore teacher training programme in the form of short course in 
test construction and evaluation methods must be implemented. A 
model for such a course in chemistry is given below. This model was 
developed at the Summer Institute on "Test construction and evaluation 
methods inChemistry” held at Jadavpur university under the sponsorship 
of National Council for Science Education. 

A MODEL FOR ONE-WEEK SHORT COimSE IN TEST CONSTRUCTION AND 
EVALUATION METHODS; 

1. Location : University (Unitary university for 

university teachers, affiliating univer¬ 
sity for college teachers). 

2. Objective : To construct a standard general 

Chemistry Test. 

3. Number of participants : 40 to 50. 

4. Pre-Institute preparation : Send out a model syllabus of a General 

Chemistry Course and ask them to 
itemise themes and concepts which 
the teachers think that students should 
know. They should also be asked to 
think what abilities they would like 
their students to develop. What, in 
their opinion, are the aims and object¬ 
ives of chemical education. Six teach¬ 
ers of organising university to be 
trained as group leaders. 
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5. Institute ProgrRmme : 

1st day —(1) Lecture on (a) Educational Objectives, (b) Types of Tests. 

(2) Participants take a 2 hours standardised General Chemistry Test 
(may be prepared by Amer. Chem. Society). This places them in the 
position of the students which will be helpful in future item writing. The 
tests are scored immediately and results retainedfor discussion of evaluation 
procedures. (This General Chemistry Test will be below the level of College 
teachers and distribution curve may not be satisfactory). 

2nd day : —^Lecture on Item writing and General format of multiple 
choice tests. Participants divided into groups for review of the items in 
the General Chemistry Test. One tutor to act as group leader. Home 
assignment—Writing items to specified items. 

2rd day :—Two test items submitted by each participant. Group 
reviewing of items to specified item. Setting up a specification for general 
chemistry test. Themes of chemistry distributed to various groups. Home 
assignment—writing item on the themes of chemistry indicating (1) key, 
(2) educational objective, (3) level of difficulty, (4) educational level. Four 
test items submitted by each participant. 

4/A day :—Review of items in Groups. Construction of a two-way 
grid for General Chemistry Test. Content analysis to check deficient areas. 
Home assignment—items for deficient areas. 

5//i day : —Lecture on evaluation procedures, and item analysis. Dis¬ 
tribution curves and setting of norms demonstrated with the help of data 
received on the first day test by the participants. Review of items submitted 
for deficient areas in the General Chemistry Test. Home assignment— 
Rechecking of Key. 

6tlt day : —^Test (about 80-100 items) ready for pre-testing on a mixed 
group of college students who have completed their 1st year and 2nd year. 
Local teachers administer the tests in their own institutions. (2 hours). 
Tests plus the answer sheets brought back. Answer sheets scored, standard 
deviation and distribution curve set up with the help of the whole class. 
For item analysis—the class divided into two groups to work on (1) the 
high ability group and (2) the low ability group. Groups may be further 
sub-divided; each sub-group to analyse; say 20 items. 

All the data collected and difficulty level (P) and discriminating power 
(r) noted against each item on the board for the benefit of the whole class. 
Final discussions on the validity of the test so constructed. If time perm.its 
some discussion on conversion of essay type of questions into structured 
questions may be taken up. The assessment of practical work is also an 
important topic. 

Institute to work from 8.30 a.m. to 5 p.m. with suitable breaks for 
coffee, lunch, etc. Suitable library facilities for working in the evenings. 

SOME OF THE TECHNICAL TERMS USED IN OBJECTIVE TESTING : — 

1. hem : This term is synonymous with conventional questions and its 
use is preferred on the ground that many so called “questions” in 
objective tests are not direct questions. They may be completion 
of statements etc. 
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2. Stem ■ The part of the item in which information is given and the 
question is framed. 

3. Responses : The list of answers from which candidates are required 
to choose the correct one. These may be numbered serially or 
lettered in alphabetical order. 

4. Kiey : The number or letter denoting the correct response. 

5. Distractors ■ Sometimes used as synonymous with responses, but 
it means all the possible response except the correct one. 

6. Difficulty level ; The percentage of candidates who wrongly answer¬ 
ed a particular item. 

7. Discriminating power-. The way in which a particular item discrimi¬ 
nates between candidates who do well or badly in the test as a 
whole. 
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Designing anc Planning of Question 
Papers 

M. KUTUMBA RAO 


A QUESTION PAPER Serves as an instrument of measurement of a student’s 
knowledge of a particular subject. It has a direct and decisive bearing on 
his performance and achievenient. Hence it should be thoughtfully design¬ 
ed and prepared. 

At present, universities in our country adopt varying procedures to 
obtain question papers from the paper-setters. Whatever be the differences 
in the procedures followed and the merits and demerits of each of these, 
the practice of appointing paper-setters for each year’s examinations is an 
annual feature in all universities. Every year boards of studies submit 
panels of names for consideration by the syndicate for appointment as paper- 
setters. Generally senior teachers only (Professors, Readers and Principals) 
are appointed as paper-setters and some of them have m.any assignments to 
fulfil. Sometimes, they accept the olfer, sometimes they decline it. When 
one declines an offer, another person has to be approached. Until all the 
persons appointed as paper-setters accept the offers, it will not be possible 
to allot the exact papers to be set by each individual. All this involves tim.e 
and a good deal of correspondence. Although it is desirable to avail the 
services of senior teachers for this work, it does not always happen that we 
get the best from them. For one reason or another they sometimes 
fail to bestow sufficient time and care in setting question papers. With 
the best of intentions, sometimes they err. They set questions in haste, 
they set questions without aquainting themselves with the syllabus pres¬ 
cribed and standard expected. Sometimes they set questions on text not 
prescribed at all or on texts prescribed in another university. 

A majority of universities provide for the holding of a meeting of the 
Board of paper-setters to scrutinise the question papers set. The purpose 
of holding such a meeting is to see that the question papers are of the right 
kind and within the scope of the syllabus and conform to the standard of 



the examination. Mistakes like overlapping of questions, repetition of ques¬ 
tions set for the previous examinations, ambiguities in the questions set and 
verbal errors are expected to be eliminated by this board. They are also 
expected to see that the paper set conforms to the pattern given regarding 
grouping of questions, choice to be given and distribution of marks to 
each question. 

Despite this provision a number of defective question papers crop up 
each year. Numerous complaints against such question papers are received 
at the end of the examinations. Often it is found that these complaints are 
not without any basis. On some occasions the mistakes are so grave as to 
compel the students to boycott the examinations and resort to acts of 
violence. 

After all the prolonged correspondence and considerable expenditure 
(which may be to the tune of one to two lakhs of rupees per annum.) if we 
get every year a few question papers that throw the entire scheme of educat¬ 
ion into jeopardy, is it not right that we should think of an alternative nie- 
thod of getting papers set? Is it not time to call for a slight change in the 
procedure followed and ensure for absolute correctness in the matter of 
question paper setting? 

I would like to suggest the setting of a “question-paper bank" for each 
subject.^ Before elaborating on the plan, I would like to make it clear that 
this is not a big ‘reform’ in examination system. It is just a different and an 
improved method of organising the whole work connected with paper¬ 
setting with a view mainly to eliminate all categories of error within the 
papers set. 

The question paper bank may be defined as a kind of reservoir of a 
number of sets of questions on each subject in which an examination is to 
be held and from which a set for any particular examination could be pick¬ 
ed at random and at a moment’s notice and sent to the press. The creation 
of this reservoir is an important collaborative work and it has lo be carried 
out in different stages and by different persons. The details of it are as 
follows : 

stage 1 

The cycle of work may be said to begin with a request to each Board 
of Studies that prescribes the syllabus in a subject to suggest certain guide¬ 
lines for setting questions in that subject. That is. along with the syllabus, 
the Board has to indicate (i) the pattern of the question paper, (//) the 
distribution of topics over the question paper, (Hi) the type of questions to 
be asked, etc. and (/v) even to prepare a model paper, fin many cases, the 
syllabus for the subject might have been already prescribed. Then, the 
Board will have to suggest only the ‘guide-lines’.) 


1. In “A note on the possibility of continuous evaluation.” Dr. H. J. Taylor 
suggested that a cell should be created in each university to be entrusted with the work 
of conducting examinations almost throughout the year, taking the examinees in batches. 
In this context he also suggested that the conventional question paper should be 
abandoned and in its place a central ‘question storage bank be created. The implement¬ 
ation of his idea, as he propounds it, is not practicable with the educational set up 
that we hnve. 
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STAGE 2 


Besides, the Boiirds of Studies will be asked to suggest suitable persous 
for preparing questions for each paper. These candidates shall be internal 
senior teachers only who are actually connected With the teaching of the 
subject concerned. From among the names suggested by the Boards of 
Studies, the Syndicate shall select some 12 or 15 for each subject and entrust 
to them the task of preparing a large number of questions that can be asked 
on the subject. They shall be first provided with the syllabus and the guide¬ 
lines prescribed by the Boards of Studies and asked to go over to the univer¬ 
sity office where they will actually prepare questions sitting in a group. Their 
deliberations will be confidential in nature. At the end of their meeting 
they are expected to give a list of a variety of good questions in sufficiently 
large number (say around 250 for each paper) to the officer concerned. 
Appended to each of the questions suggested by them, there shall be a gist 
of its answer too, which will be consulted at the time of valuing the answers. 

stage 3 

The screening of all these questions by an expert committee consisting 
of at least three internal specialists in the subject marks the third stage in 
the Work. The committee will finalise the questions (with modifications 
and additions wherever necessary). The questions thus finalised will cons¬ 
titute the ‘question paper bank’- 

STAGE 4 

Another committee (selection committee) consisting of not more than 
three experts (all of them external)shall be constituted and entrusted With 
the responsibility of making four (for two years) question papers in the case 
of language subjects and six sets (for three years) of question papers in the 
case of other subjects in accordance with the guidelines for paper-setting 
given by the Boards of Studies. The committee should be asked to select 
questions from the bank only. They should not mention the year (or 
month) of the examination in the question papers compiled by them. They 
should place each paper in a cover specially designed for the purpose (the 
cover bears the Code number and title of the question paper) and hand it 
over to the officer concerned, after sealing it. 

An interesting feature of this plan that I am suggesting is that there 
is certain amount of “openness” or “knowability” in the matter in all the 
earlier stages. It is only from the stage when the selection committee com.es 
to attend to the business of preparing the question papers and sealing them, 
do matters become really confidential. And from then on there is practical¬ 
ly no scope for any one, including the Registrar or the Controller of Exami¬ 
nations to know anything except the press and his humble helper, as will 
be clearly seen from what follows. 

STAGE 5 

The officer concerned will pick up one sealed cover (out of the four or 
six sealed covers handed over by the selection committee) and send it without 
opening it to the press for printing. If a thousand question papers in differ- 



ent subjects for different examinations for a year are to be printed, the 
press will receive a thousand sealed covers, each sealed cover containing 
just one question paper. 

STAGE 6 

The press Will open the sealed cover and print the required number of 
copies of each question paper. The press should be asked to pack them 
into sealed packets of various denominations and send them to the officer 
concerned. For example, if ten thousand copies of a question paper are 
to be printed, the press may be requested to pack them into small packets 
as follows ; 

70 sealed packets containing 100 copies each, 

40 sealed packets containing SO copies each, 

40 sealed packets containing 25 copies each. 

If 673 copies are to be despatched to any examination centre, six packets 
containing 100 copies each, one packet containing 50 copies and another 
containing 25 may be despatched in a sealed cover to the centre. The sealed 
packets need not be opened at the university at all. Under this system per¬ 
fect secrecy of the question papers can be ensured. 

advantages 

The benefits derived in setting of a question paper bank are as follows: 

(1) There cannot be any complaint against the questions set for an 
examination because all those are chosen from the question 
paper bank. 

(2) The teacher who actually teaches the subject and is acquainted 
thoroughly with the problems of it will have a big say in the matter 
of setting the questions to be asked, once this plan is accepted. In 
the existing system the teacher is not consulted on this issue. 
Often the questions set surprise and even shock him as they are 
difficult to answer for the students. With the scheme suggested, 
this Will not just happen. The teacher as well as the student 
will have nothing to complain of. 

(3) The above system ensures secrecy. For as we have noticed above, 
even the Selection Committee does not know v<hich of the four or 
six papers is going to be used for the particular examination. 
And the officer in charge is not aware of the contents in the 
packets. 

14) The system under this ‘question-paper bank’ will work satisfac¬ 
torily under all kinds of systems of examination. It will work 
well with the present mode of holding examinations, it will work 
equally well when the objective tests are introduced. 

(5) A subsidiary benefit of the schente is the increased efficiency 
and reduced cost in organising the work connected with paper 
setting for the office. 

This is a simple system that I have prepared and 1 hope that put to 
te.st it will prove to be a success. In drawing it I have taken care to see that 
it is not very sophisticated. In my view it is easy, workable and beneficial 
to all concerned. 
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Question Setting and ^^oceration 

A. K. GAYEN, 


THE EDUCATION COMMISSION (India), 1964-66, rightly observed that most of 
the weaknesses in the present system of examinations are due to defects 
in the questions and the question papers. The paper setters are often ap¬ 
pointed on the basis of seniority, subject competence and experience in 
leaching. Very few of them possess the necessary knowledge of construct¬ 
ion of valid and reliable tests. No improvement is possible unless the tech¬ 
nical competence of the paper-setters is raised through an intensive training 
programme and unless also the question papers are oriented to testing not 
only acquisition of knowledge but also problem-solving abilities of the 
candidates. 

In an examination, internal or external, the question items must have 
discriminating power, so that they may help ranking of candidates in order 
of merit, or classifying them into several groups of superior or inferior abi¬ 
lity. They should be reasonably difficult, so that there may not be very 
high Or very low scores on the items. They must have good reliability, so 
that the answers to the question items may reflect the ability of the candi¬ 
dates in a consistent way. They must be reasonably valid so that they may 
measure the true ability of the candidates in the subjects concerned. 

If on a question-item, all candidates secure full or equal marks or fail 
to score or there is no attempt at all, then that question-item does notappear 
to have any value from the examination point of view, for it does not help 
ranking. If the language in which a question is framed is vague and ambi¬ 
guous, admitting of various interpretations both by the examinees and by 
the examiners, then that question-item is of very little value from the exami¬ 
nation point of view, because it introdiwes lack of uniformity in the, assess¬ 
ment of answer-scripts and thereby vitiates the reliability of the examination. 
I fa question-item is such that it requires only acquisition of information on 
the part of the candidates rather than real understanding of the subject and 



development of thinking, then the item may not carry any value, as it docs 
not measure the true abilities of candidates in a subject. 

The principles of paper-setting in an examination and the functions 
of the different types of question items should be properly understood. 
Essay-type questions test candidates’ power of expressing coherently a train 
of logical reasoning, their ability to choose the length of the answer, and 
their power of describing the kind of facts involved. Achievement tests 
with essay-type questions thus put a high premium on the power of expres¬ 
sion. But in times of pressure or stress, some pupils frequently fail to do 
themselves justice and fail even to realise what is required of them. A 
little ‘prompting’ may make a difference in such cases, and objective tests 
may provide this prompting. Answer of one or two words can test know¬ 
ledge of facts, and answers of a line or two of writing can test power of gene¬ 
ralisation and thought. Similarly, supplying missing words, selecting ap¬ 
propriate terms, or deleting the incorrect ones of suggested alternatives, 
can test application of knowledge and power of reasoning. 

We have also to devise other evaluation methods, such as observational 
techniques, oral tests and practical examinations, and to make them valid 
and reliable. In an essay type examination one cannot set more than six 
or eight questions in a paper of three hours’ duration, and it is therefore 
difficult to ensure that the syllabus is covered adequately. It seems, to make 
a better form of examination, we should combine objective and essay type 
questions. The objective type questions alone cannot form, a complete paper 
for an examination. The essay-type questions must be provided for answers 
demanding description of practical procedure, application of theories, 
working of problems, and the formulation of explanation and comparison. 

As education today is examination-oriented, a paper-setter has a very 
important role to play. But he has his limitations, for his work, however 
perfect it may be, is bound to be circumscribed by the different standards of 
teaching in different institutions, by the different levels of ability in the teach¬ 
ing personnel, and by the calibre of students who take the examinations. He 
must set the questions from within the syllabus, but the trouble is that the 
syllabuses so prepared by the universities are very often if not always ver\' 
cryptic, and not at all descriptive. This is the root of many evils. First, 
text book writers write books in accordance with the syllabus in their own 
light. Naturally there are differences in the treatment of topics by the writ¬ 
ers. One college follows one book, and another college another. Nobody 
knows what book is followed by the paper-setter when setting questions. 
It is evident that students of different colleges do not or cannot deal with the 
questions in the same way. This disturbs the uniformity of performances. 
There is yet another problem of paper-setting. If stock questions are re¬ 
peated every year it encourages cramming; guess work pays good dividend, 
and therefore true merits can never be judged. If a paper-setter can apply 
his ingenuity and set new types of questions then that would require suffi¬ 
cient notice to the teachers and the students. 

Technically speaking, an ideal paper-setting requires that the paper- 
setter must have at his disposal a pool of valid and reliable questions (already 
prepared by some research or evaluation units) and must have the training 
to suitably utilise the same. Also a detailed and descriptive syllabus is a 
must in this matter. The teachers and the students, the paper setters and the 
examiners, all must know how well and how much of a subject the students 
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are expected to know. It is only then that teaching, learning and testing 
would be meaningful and fruitful. There should be gradual introduction 
of short-answer and objective-type questions. The paper-setter should split 
the allotted round mark on a question item into as many parts as the num¬ 
ber of aspects of the item. 

The relationship of the question paper with the prescribed syllabus is a 
very important aspect of an examination. The syllabus, as we know it, 
describes the topics or rather different areas of the subject. It is the basis 
on which the teacher teaches in the class-room, the student prepares him¬ 
self for the examination and the paper-setters set questions to test the stu¬ 
dents’ achievements. As has already been noted a question item is not 
valid if it refers to a topic which is not included in the prescribed syllabus. 
A good syllabus should not be mere catalogue of topics; it should give a 
concrete shape to the teaching objectives of bringing about desirable changes 
in the student behaviour through the learning process. The syllabus of a 
subject should clearly state the aims and objectives of teaching that subject 
and list the concepts which are required to be developed. The real purpose 
of an examination is to see how far teaching objectives have been realised. 
An examination defeats its own purpose if it is conducted through questions 
which do not relate closely to the teaching objectives and the concepts of the 
syllabus. 

How to formulate the teaching objectives and when and by whom? 
One view is that framers of the syllabus should co-operate with subject- 
specialists and teachers of class-rooms and research workers in the field of 
the subject concerned and formulate the teaching objectives. It is then and 
then alone that it would be possible to frame a well-defined syllabus. Natu¬ 
rally, teachers in class-rooms will be guided by the teaching objectives and 
they will test their pupils from time to time to see whether these objectives 
are being achieved and the necessary concepts developed. The paper- 
setterof the final external examination,while setting questions should have 
the aim of coveringthe concepts and the objectives involved in the subject. 
So he would set questions which should go to measure the effect of teaching 
in the realisation of the objectives. Lastly, the work of assessment would be 
left to the examiners, who would record the achievements of students in 
terms of the objectives involved. 

There is a second view according to which the paper-setter has a very 
important role to play. He is in a position to set the ball rolling and to tone 
up the entire educational system. He may take the syllabus as it is, and 
by analysing it determines the teaching objectives which the different parts 
of the course may involve. By setting questions, each of which goes to 
measure one or more objectives he may help a great deal the teachers, the 
students, the examiners and the future framers of the syllabus. He should 
assess whether a test item would function in the expected way, that is, how 
far the teaching objectives have been taken into consideration in the item 
and with what weightage. By post-mortem analysis wherever possible he 
should determine the cause of malfunction of an item and statistical clues 
should be reinforced for the purpose by familiarity with the thinking and 
the language habits of the students. In the light of such findings he may 
improve the question paper and recommend measures for improvement of 
the syllabus. 

There should be a body of paper-setters on a subject, and they should 
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be helped by a study unit. This unit should compare and analyse the sylla¬ 
bus and the text books of several years of several boards and universities on 
a particular subject or subjects, collect material from research papers and 
gather views of subject specialists. Thus they may evolve teaching object¬ 
ives and the concepts involved in the subject concerned. Mere collection 
of a pool of question-items will not be enough for the purpose, unless these 
items lire classified from the view-point of teaching objectives; it is only when 
teaching objectives are achieved that we may expect improvement in the 
behaviour of the learners. 

The quality of question-items of a paper may be estimated with the help 
of an analysis chart. In this chart, every question-item may be shown 
against one or more objectives and the weightage, that is the mark allotted 
to each of the objectives, may be ascertained so that the total weight of all 
the objectives is equal to the total marks allotted to all the questions of 
the paper. From this chart it may be easy to detect whether one or more 
objectives have been left out altogether, whether too much weight has been 
given to a few of the objectives only, and whether Weightage has been distri¬ 
buted according to the relative importance of the objectives involved. Ano¬ 
ther such analysis chart may then be prepared in respect of coverage of to¬ 
pics in the syllabus and a comparative study of the syllabus and the question 
paper from the view point of the objectives may be made to formulate useful 
suggestions for improvement in the system of education and examination. 

Internal choice, that is, offering alternative questions in a paper has both 
its good and bad effects, when it is not possible to cover the entire subject 
area in a three-hour paper, alternatives are a necessary evil. By this, a 
candidate may select a group of questions which he has prepared and in 
which he has sufficient interest. At the same time, too many alternatives 
help un-intelligent cramming and encourage the students to make guess¬ 
work and depend on suggestions. As the object of public examination is 
measurement of knowledge and -not discovery of ignorance (which is 
essential for teachers in a class room), alternative questions are perhaps 
unavoidable. If alternative questions have to be abolished the syllabuses 
have to be curtailed. 

The alternative questions which are very often set appear to be some¬ 
what responsible for disturbing reliability. It is said that the setting of alter¬ 
native questions enables the paper-setters to cover a greater part of the sub¬ 
ject area. 'tYvc g,cxveTa\ abWity 'o wtvte correctly’ h the thing to he 

measured and when the fact or facts involved are not important for consi der¬ 
ation, the alternative questions are found to be helpful. For instance, of a 
number of topics, when candidates are asked to write an essay on only 
one, whatever question item a candidate may choose, his ability to write 
will be measured from his composition. All these are arguments in favour 
of setting alternative questions. 

But stronger points may be put up against setting of alternative ques¬ 
tions: (;) If this topic or that topic is not important for measuring writing 
ability, alternative questions are superfluous, (it) The argument that greater 
opportunity is given to candidates in choosing his subject does not hold 
good because through bad judgement a candidate may not hit upon the best 
choice, that is, the topic on which he could write best, (in) Increase of the 
number of alternatives, when the number of questions to be chosen is small, 
would encourage cramming as the student memorising a selected number of 
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questions would be surer to get his choice. (I'v) If the candidate is to choose 
his own topic from among many given by the paper setters, it may be that he 
may present something prepared beforehand when he could write nothing 
at all on any other topic Which he had not chosen, (v) It is very difficult 
to discriminate between students who can answer just the required number 
of alternatives and who are capable of answering many more. Considering 
all points of view it may be said that alternative questions should perhaps 
be avoided as far as practicable and all candidates should be allowed to run 
the same race by answering the same questions which must refer to a definite 
and specified information or idea. 

Possible formulation of solution to questions in an examination in order 
to help the examiners in assessing students’ performances is definitely a 
desirable move. But in preparing the solutions the paper-setter must not be 
left alone. He should be assisted by a group of subject experts and experienc¬ 
ed teachers. Defects of subjective assessment are well known. Objective 
assessment of objective type of questions is the other extreme. Combi¬ 
nations of essay type questions and objective type questions in the same 
paper has been recommended by various bodies and is certainly worth 
experimenting upon. 

In the examiners' meetings, the model answers to all the question-items 
of the paper, prepared beforehand by the paper-setters, head-examiners 
and moderators, should be discussed thread bare, and detailed definite direc¬ 
tions should be given to the examiner. In these directions how different 
aspects of an answer to a question-item should be assessed and graded must 
be clearly shown, just in the nature of an objective chart, so that all that 
is humanly possible to bring about uniformity of judgement of examiners is 
not left undone. There should be minimum scope for an examiner to exer¬ 
cise his or her discretion in the assessment of student performance on any of 
the question-items of a paper. The proper use of model-answers should 
form a sound basis of ranking in the examination. 

In a large scale examination, examiners naturally large in number, must 
each be provided with a copy of model answers, besides detailed instructions 
for assessment. These things are necessary to reduce subjectivity in assess¬ 
ment and thereby to ensure reliability of the examination as far as possible. 
At present, the examiners examine the scripts at home and submit them to the 
head examiners, who generally re-examine about five per cent of the scripts 
to see that a common standard of assessment has been maintained. But t lis 
appears to be hardly sufficient for bringing about uniformity of assessment, 
particularly when the number of scripts each examiner examines is also large. 
A suggestion in this connection is worth experimenting upon. Arrange¬ 
ment should be made, to have the answer-scripts examined in several joint 
sittings of the examiners with the bead examiner presiding. In these sittings, 
to be continued for several days, answer-scripts should be examined and all 
differences of views regarding assessments of answers resolved then and there. 
Some may consider this suggestion impracticable and may propose examina¬ 
tion of a few sample scripts, in such joint sittings. But examination of only 
a sample of scripts, we are afraid, will not serve any very useful purpose. 
‘The examiners sjould remain together until all the papers have been marked 
rather than returning home after they have read a sample, which is the prac¬ 
tice of some universities’. 

Majority of teachers of schools are not conversant with the technique 
of assessment in public examinations, because they are not appointed as exa- 
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miners. Hence performances of studenis taught by such teachers are not a 
true index of their abilities. Many examiners again have no clear idea of the 
method of teaching in class-rooms, because the examiners appointed by the 
Boards or Universities are not necessarily teachers of those whose scripts 
they examine. Cryptic instructions to examiners are sometimes responsible 
for widely different assessments of the same tyoe of answers. Also tie ques¬ 
tion of homogeneity of students is particular y important when a large scale 
public examination is conducted mainly through essay type questions. The 
candidates should receive the same kind of instruction from the same type 
of teaciers. 

Moderators should be looked upon as super-oaper-setters whose business 
should be to examine thoroughly whether valicity, reliability of the ques- 
ions have been secured, or whether the questions have been set strictly within 
the prescribed syllabus. All the qualities necessary for a good paper-setter 
should be in the moderators in an extraordinary degree. It is often found 
that nothing is probably done in the name of moderation. Moderation of 
question papers which is done in any Board or University is very often a 
formal matter. Moderations seldom interfere with paper setting work and 
when they do. they either make the paper more difficult or more easy. Nei¬ 
ther of the two goes a great way to improve the system of examinations from 
the view point of education. 

The examiners, may greatly influence the reliability of a public exami¬ 
nation. It is very essential that they possess certain specific qualifications. 
An examiner should be conversant with the technique of assessment. He 
must be thoroughly acquainted with the course contents of the subject with 
which he is concerned. He should have a first-hand knowledge of the method 
of instructions given to the students and also of the students who are candi¬ 
dates for the examination. In short, experienced teachers of a subject 
should be appointed examiners of that subject. 

It may be observed that examinership usually is looked upon by the 
Boards or Universities as a non-technical business; but unfortunately it is 
not at all so. An examiner or a board of examiners in a subject should be 
given a thorough formal training and they must be assisted by the paper-set¬ 
ters and the moderator?, who would help them with a solution or model 
answers, and in awarding of marks on different aspects of the examination 
questions. The idea that any teacher however inexperienced he may be is 
fit for examinership should be given up altogether. 

The best practice would be to entrust the entire responsibility of selling 
of question-papers and their moderation as well as the valuation of answer- 
books to persons who impart instruction. The local teacher cannot be 
ignored altogether. It may be further noted that while the most capable 
external expert, even with the best of his intentions, may fail to draw the 
question paper suitable to a locality, an internal examiner is the real judge 
of the achievement of his own students. Often the question papers, if entirely 
^awn by outside experts are found to be either stiff or are out of the way 
It is desirable to appoint a board of examiners for each examination, where 
to start with half the examiners should be internal teachers. The final 
settlement of the question papers can be either done in a joint meeting or 
through correspondence. While distributing the job of valuation of answer- 
scripts, care should be taken that no one examiner has more than 250 scripts 
to assess. 

Every university has its own procedures for the appointment of paper- 
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setters and moderators of question-papers. In some of the universities, all 
the paper-setters are external experts who moderate the question papers 
as well. In others, setting of question-papers and their moderation are 
shared equally by internal as well as external examiners. In some of the 
universities, the question-papers are moderated by a board of interna] experts 
only. In many statistical studies on examination results it has been found 
that average marks on the internal and the external assessments differ signi¬ 
ficantly in all subjects of the examination. 

The present system of making appointments of examiners needs to be 
reviewed. According to the present system, a panel of examiners is pre¬ 
pared by the Boards of Studies. There is a provision that the committees 
constituted make recommendations regarding the appointment of examiners 
from the panel to the Academic Council and then to the Executive Council. 
The panels as well as the recommendations of the committees go to the Aca¬ 
demic Council or Senate. It is obvious that in these circumstances it is 
difficult to maintain secrecy about the appointment of examiners. In cer¬ 
tain universities, the appointments are made directly by the Vice-Chancellor 
himself on the basis of the recommendations of the relevant committees. 
This also may need consideration in any plan for examination reform. 

A written test, even a series of written tests, is not sufficient to bring 
out the capacity of a candidate to the fullest extent. It is now a common 
fact that most of the students rely on either suggested or stock questions, 
and they have formed a habit of neglecting the text books or going through 
the entire or even a major part of the course content of a subject. These 
evil practices may be mitigated through the de\ ice of a practical examination 
and a viva voce test. While removing many of the drawbacks of the exa¬ 
mination consisting of written papers only, the practical and the vi\ a test will 
also help the students in two ways. They will be required to go through the 
text books in order to prepare themselves for the practical and the oral 
examination. This will increase his probability of passing the examination 
because unlike a written test where five or six specific questions have to be 
answered for a pass, the students will have greater scope in a practical or oral 
examination. The other good point in a viva voce test is that there is no 
scope at all. for obvious reasons, for taking recourse to unfair means at the 
examination. 

The conduct of viva voce test for a large number of candidates may ap¬ 
pear to many as very difficult. But we do arrange for practical examination 
in science subjects even if the number is very large. .Although the number of 
students in humanities will be larger than those in science and it may be more 
difficult to arrange for viva, still it should not be considered as insuperable. 
Wc can at least make a beginning by introducing \ i\a in the examinations 
where the number of candidates is not very large for instance in Honours 
degree examinations. In this way the best students of the university can. 
in the first instance, be brought under the new system of examination, and 
gradually wc can introduce viva voce test in other examinations also. The 
number of persons and a mount of time involved to hold these oral tests are 
of course a thing to ponder over. The best suggestion would be to havethe 
viva voce and the practical experiments in science subjects in the internal 
tests. It is well known that in higher examinations, at the Master and 
the Doctorate degree levels viva voce tests always play a very important role. 

The internal assessment system, as it functions with us, is based on a 
complete trust in the teacher, with built-in safeguard. The teacher taking 
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a particular course administers all the tests, sets all the papers, supervises all 
the examinations and does all the grading. He is both instructor and the 
assessor. As a result, the assessment at all stages is intimate without being 
unfair or loaded. It is related, as it were, to the totality of the students’ 
personality. The process of assessment of a script does not envisage a disso¬ 
ciation between the script and the personality of the examinee. The teacher 
is, for all practical purposes, the final judge. A living link is established 
between the teacher and the student, who participate in the process of assess¬ 
ment in a way impossible in the external examination system. There is no un¬ 
evenness in assessmnet as the scripts for a particular course are all assessed 
by the same person. The question whether or not the teacher in India can 
be trusted to this extent has been constant matter of debate. Our experience 
is that the teacher can be so trusted. The same experience has been repeated 
in Agricultural Universities and in the Indian Institutes of Technology. 

It may be noted that unless the universities are coordinated in methods 
of examination and assessment and paper-setting, appointment of external 
examiners is an indirect aspersion on the teachers of the university con¬ 
cerned and has the chance of doing injustice to the candidates. Plainly 
speaking, the very question of appointment of external examiners as is now 
done in examining theses for doctoral degrees should not be introduced in 
under-graduate or post-graduate examinations of a university. The question 
of appointment of external examiners may arise when the authorities suspect 
the teachers or when a bias is detected in the matter of assessment of answer- 
scripts. 

Finally, it may be observed that apart from the improvement of ques¬ 
tions and question-papers, many other procedures of examinations need to 
be made more scientific. The marks of different subjects are now added 
without being standardized. The determination of cut-oif points, the award 
of grace marks and other similar methods are also not based on any sound 
principles. All these factors tend to make the examination scores less and 
ess reliable. It is essential that scientific scoring procedures should be de¬ 
vised so that there may be optimum reliability in the assessment of the candi¬ 
dates’ performances. The Indian Education Commission. 1964-66 recom¬ 
mended in this connection that the University Grants Commission should 
set up an Examination Research Unit for Higher Education which should 
work in collaboration with corresponding psychometric units of the univer¬ 
sities. This should become the starling point of an effective programme of 
examination reform. 
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^^oceration; Views and Suggestions 

N. C, AGRAWAL 


MODERATION : NATURE OP WORK AND LIMITATIONS 

In the universities of Uihar the Examination Boird appoints a Board of 
Moderators in every ‘ubje.t which usually consists of four members, 
generally three of which arc internal members and one an external one. 
On the recommendations of the Moderation Boards the Examination 
Board appoints the paper-setters, the head-examiners and examiners in 
various subjects. Such Boards also moderate questions and the results. 
Under the present arrangement the examinees not only come to know the 
names of the examiners, but often we come across the report of leakages 
of questions. The most surprising thing is that the questions which 
leak out find their way in Gue,ss Papers published by big publishers. It 
has also been reported that members of the moderation boards secretly 
pass on the set questions on certain fat payment from the publishers. 
Even if we take a position that these reports are incorrect, 1 hold the 
view that the moderation of questions is of no great practical utility on 
which universities spend lacs of rupees. The earlier this system is given 
a good-bye, the better it is for all concerned. 

Many universities in India have abolished tlie practice of question 
moderation without any ill-effect or difficulty. The example of Rajasthan 
University outside Bihar and Ranchi university in Bihar can be cited. 
Teachers of integrity be appointed paper-setters and head-examiners so as 
to avoid mistakes in the question papers. In case there is any dearth of local 
talents, teachers outside the university can very well be appointed paper- 
setters. Even the Board of Moderators can very well set the papers. 

Thus, the earlier the moderation of question is done away with, which 
is an unnecessary appendage to the Board, the better it is for all concerned 
and it not only saves the money and the time of the universities and enable 



them to publish results earlier, it will help them restore the dying faith in 
the impartiality of the examination system which we loudly profess. 

PEBSONNELS : PROPOSAL 

The composition of the Boards has already been stated. But to keep 
the Boards free from any semblance of doubt about its impartiality the Uni¬ 
versity of Utkal has gone a step forward in this direction. It appoints all 
external members on the Boards of Moderators. The chairman of a board 
may hold its meetings at a place of his convenience. Far from the politics 
of a university as well as largely unconcerned with that, the Boards usually 
transact business beyond the sphere of influence. If this pattern is adopted 
it would not only maintain impartiality in relation to the appointment of 
paper-setters, head-examiners and examiners, which is to a very large extent 
responsible for polluting and corrupting the atmosphere of the universities, 
but would also save honest and hard-working teachers from the caprices and 
whims of their departmental bosses, notwithstanding other gains. 

TERMS 

At the momeni most of the universities appoint Boards of Moderators 
for a pieriod of only one year. The tenure is of too short a duration. If 
any Board wants to set the matters right, it simply cannot do so in a shori 
span of one year. As such if we wish to effect improvement, the term of 
appointment of the members on the Board be extended from one year to a 
period of five years. With its introduction no harm is likely to be caused to 
the interests of the teachers of a university because all themembers would be 
external members selected on the basis of eminence in ilieir respective fields 
with moorings outside the university and even the State. 

POWLH 

Such Boards may not be only given the power to recommend names of 
paper-setters, head examiners and examiners, but also to recommend punish¬ 
ments for the erring ones. They should have the power to recommend can¬ 
cellation of setting for the leakages of questions, for the maintenance of 
secrecy and for other mistakes. 

QUESTION-SETTING 

In conclusion it may be said that I tried to identify ihe weaknesses of 
moderation and offered certain solutions for their eradication. I am sure, 
they will go a long way to lift the university education from thepre.senl morass 
and provide the society with the right kind of leadership in all walks of life. 
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Question Settinganc '/Moderation 

H. BHUMU 


A('nit\i.MLNr ui MX'CLSS Of failure in the managcmeiit and conduct of an 
examination depends, to a great extent, on the method adopted and the 
lype of question papers set for the examination. Questions should be so 
.set that the following objectives can be achieved : ri:. (f) Complete covering 
of the syllabus with wide choice in answering questions will defeat thepurpose. 

belter method would be to have restrictive choice, that is among related 
topics only choice may be allowed so that nobody can get away by reading 
only a pari of the sylfabus and still get good marks, (i7) Questions of dif¬ 
ferent branch of difficulty should be made compulsory, so that total marks 
to some extent, at least, reflects the difference to ability of the candidates. 

APP01MM£,\T OF PAPEJI-SETTEJIS 

.Appointment of paper-setters should be made I'rom the panels of paper- 
setters prepared and approved by the Board of Studies. It is desirable that 
the constitution of the Board of Studies for Postgraduate and Under¬ 
graduate Courses may. to some extent, be different. 

(1) For Postgraduate course, the Board of Studies in a Subject, 
Branch of Study should consist of: (i) only one Professor or Head of the 
Department of the university in the Branch concerned, as Chairman of the 
Board, {ii} at least three experts in the subject, from other recognised uni¬ 
versities of the rank of Professor or Head of the Department. 

(2) (a) For Undergraduate Courses, vi:. P.U„ B.A./B.Sc./B.Coiii. 
the Board should consist of (/) only the Professor or Head of the Department 
of the university in the subject concerned, as Chairman of the Board, (ii) 
at least two experts in the subject of the rank of Professor or Head of the 
Department from other recognised universities. One retired person having 
teaching experience in the subject in degree affiliated college/institution may 
be associated, if necessary, (b) Medical, Engineering: (7) Head of the 



Institution, as Chairman, (ii) only one Professor or Head of the respective 
branches of study. (Hi) at least two experts in the subject of the rank of 
Professor or Head of the Department from other recognised universities, 
(c) B.T., Law and other Professional Courses: (i) Head of the Institution, 
(ii) at least three experts on the subject of the rank of Professor or Head of 
the Department from other recognised universities, (iii) one retired person 
having teaching experience in the branch of study may also be associated, 
if necessary. 

DIJIECTIONS TO PAPER-Sbi lEKS 

(1) While setting papers, the paper-setters shall be guided relating to 
the scope of the subject of examination, by the syllabus and course prescrib¬ 
ed in conformity with the standard and extent of knowledge supplied by the 
books as recommended from time to time for such purpose. (2) No question 
shall be asked which would require an expression of religious belief on the 
part of the candidates. (3) The questions set should cover the entire course 
and they should not exceed the limit prescribed for the examination. (4) 
The paper set should be such as candidates can reasonably be expected to 
answer within the time allotted. (5) The language of the question should be 
simple, clear and unambiguous and the questions should be so framed as to 
encourage good methods of work and teaching and to discourage unintel¬ 
ligent memorising. (6) A question paper should not ordinarily be a ver¬ 
batim copy of the one set in ^revious year. (7) Paper-setters, as far as practi¬ 
cable, should avoid any marked change of standard from year to year. (8) 
The paper set should have some questions which can reasonably be answered 
by students of average merit, i.e. about 60% of the questions set should be 
of general type. It is also desirable to have some questions about (40%) 
of competitive type aimed at testing their understanding and intelli¬ 
gent appreciation of the subject. 

MODERATION 

Paper setting or Moderation of paper is strictly confidential. Secrecy 
and sanctity are to be maintained for all the time at any cost. The 
secrecy of the appointment of paper setter and the paper set must be 
strictly maintained while the papers are moderated. As such, to maintain 
secrecy and sanctity, one-man-Moderation Board for a particular paper or 
subject is preferable to a Moderation Board consisting of several heads. 
So it is desirable that:— 

(a) Paper set by a person should be moderated only by a second person 
in the subject from the panels of paper-setters approved by the Board of 
studies. (6) Paper set by Externals should be moderated internally and vice- 
versa. (c) Moderation of paper, as far as practicable, should be restricted to 
Professor or Head of the Department of the university, {d) During mode¬ 
ration, the essential articles, viz. (i) prescribed text-books, from which the 
questions have been set, (ii) sample question papers of the previous years (at 
least of two years), (Hi) sample question papers of the test examinations 
of previous years collected from the degree affiliated collcges/institutions, 
(iv) detailed course and syllabus, and (v) other necessary requirements, should 
be made available to the moderators. 
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Practica. examinations 


K. K. NAIR 


Examinations do not have any intrinsic value by themselves but they serve 
as a means to an end, the end being an efective measurement of the achieve¬ 
ments and accomplishments of the candidates. Therefore, before we speak 
about the necessity, and mode of practical examinations, we should have a 
clear understanding of the aims and objectives of laboratory courses. 

It is universally agreed upon that experimental work is vital in any 
science and applied science course. Theoretical knowledge and the experi¬ 
ment to test and verify its validity go hand in hand and are complementary 
to each other. The success of a laboratory programme consists in achieving 
prescribed physical results and the laboratory is a means of demonstrating 
this to the student. 

There is more or less a general acceptance of the aims and objectives 
of the laboratory work. They are : 

1. To demonstrate and reinforce the principles set out in theoretical 
lectures and to enhance the students’ interest in the subject; 

2. To familiarize the student with the methods of collecting experi¬ 
mental data, which involve the understanding of instruments and 
practice and ability in using and handling them; 

3. To give experience in operating and testing instruments, equipment 
and machinery; 

4. To give training in methods of analysis and interpretation of data. 
Concepts of reliability, reproducibility, accuracy and significance 
need emphasis; 

5. To impart training in the preparation of scientific and technical 
reports; and 

6. To develop ability and resourcefulness in planning and executing 
projects. 



It should be quite obvious that the success of laboratory work is parti¬ 
cularly dependent on the teacher as it de'iends more on his inspiration, 
energy and resourcefulness than on any otier factor. Good equipment is 
desirable and essential for advanced work, but at the junior levels highly 
creative work can be done with elementary equipment. Flexibility and sim¬ 
plicity are very important in laboratory work for the realization of the above 
objectives. The success also depends upon the way the laboratory courses 
are organized and programmed during the total course duration of three or 
four years. For instance, at the earlier stages the emphasis should be on 
howto collect data, how to handle the available instruments and to introduce 
the concepts of reliability, accuracy, reproducibility, etc. Unless the stu¬ 
dent is properly motivated he often gets bored by the procedure which he 
goes through in a routine manner without understanding and appreciating 
its importance and in that process he does not learn much. It is also equally 
important that the laboratory work should be supervised by the persons giving 
the lectures. The idea that the laboratory instruction could be treated as 
chores for junior teachers has been the bane of such courses and should be 
duly exercised. The work involved is such as to tax the very best members 
of the staff. 

The achievement of a student in his work is dependent on the 
amount of motivation generated in the student. The student’s achievement 
is the product of the student's natural ability, times the motivation 
integrate over the period of learning A strong intellectual challenge 
is the most effective means of motivation and our educational system must 
develop in this direction. Even a student of superior ability who loses his 
desire to learn, quickly becomes an academic liability and such arc the .slu- 
deiits who generate the endless troubles on the campuses. 

We shall now turn our attention to the main topic under discussion-- 
the practical examinations. Hero again 1 propose to sursey briefly the pur¬ 
pose of examinations in general. Broadly speaking, examination could be 
considered as a method of measurement. It is an essential part of the teach¬ 
ing process. 

Examinations have come in for a variety of adverse comments over the 
years. However, there are no two opinions about the important fact that 
examination is an integral part of any educational system and its lotal aboli¬ 
tion is hardly possible. Most educationists seem to agree on the aims and 
objectives of examinations. They may be summarised as follows ; 

1. To make the student work up to a schedule. 

2. To enable him to acquire the stated degree of knowledge and compe¬ 
tence in the subject. 

To test his capacity to understand and assimilate an idea or a con¬ 
cept and his ability to reproduce the knowledge he has acquired. 

4. To give to the outside world a mode of assessment, a criterion for 
comparison of the attainments and worth of the students. 

5. To provide inducement to the teacher to treat his subject well with¬ 
in the prescribed time limit. 

6. To maintain standards of teaching. 

7. To serve as a measure or index of self evaluation for the student. 

8. To indicate the suitability or otherwise of a student for further study 
and training. 
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The main problem seems to be, how do we go about organization of 
Ihc system of examination to realize in practice the above mentioned and 
widely accepted objectives. One of the earliest comments on our education 
system dates back to 1902 in the report of the Indian Universities Com¬ 
mission, viz. our teaching is subordinated to examination and not examina¬ 
tion to teaching. Similar observations have been made subsequently. No 
system of examination can be satisfactory unless it involves the teachers, 
the taught and the administration in an intimate manner. The purpose 
of an examination is not to declare the student as unworthy but to provide 
incentives to him for self-improvement. As such it should enable a student 
to detect his shortcomings and limitations well in time to provide him with 
opportunities for improvement to enable him to overcome such limitations. 

Examinations are methods employed in a process of quality control. 
Quality control methods are adopted, implemented and improved upon from 
lime to time to meet the changing needs and to ensure that the final product 
conics up to the pre-determincd specifications and standards of produc¬ 
tion. Quality control is a process and not an isolated event in the manu¬ 
facturing process and has to be applied at different stages of production. 
If wc apply the stringent quality control measures only at the final stage of 
production, /.t'., to the end product, it may turn out to be disastrous and 
the industry may not thrive for long in a competitive world. Judging the 
student by his performance at the fag end of the course amounts to this 
and should not be taken as an effective method of assessing the competence 
of the student. Such a system of examination could never give a proper 
measure of the achievements of a student nor would it provide him with 
opportunities for self improvement during the duration of the course. How¬ 
ever, if a properly programmed examination system is spaced at regular inter- 
sals during the course duration it would naturally ser'c as a better method of 
measurement. 

Let us no'A turn our attention to the system of practical examinations 
we would like to design and implement in consonance with the aims and 
objectives of laboratory courses and examinations. A meaningful and pur¬ 
poseful practical examination should be creative. The problems should 
require thought, analysis and understanding of the concepts and of course, 
good judgement. The basic question that arises then is whether such exa¬ 
minations are feasible. With the very rapid increase in numbers, practical 
examinations have tended to become a somewhat routine affair and highly 
expemsive too, without serving any really useful purpose except to ensure 
satisfactory attendance in the laboratory classes, as a minimum amount of 
familiarity with the available equipment is necessary. If our aims and 
objectives of examination are as what we have stated earlier and if we beat in 
mind what we have discussed as the aims and objectives of laboratory courses 
and the method of implementation of these courses. 1 feel we can do away 
with the existing type of practical examinations yielding place to better and 
more effective and productive methods. In the conduct of practical exami¬ 
nations, at least, it should be possible to integrate examinations with the 
overall laboratory courses so that the results could be made more reliable, 
dependable and to have a direct correlation w'ith the day to day work of the 
.student and the instructor. The qualities, such as the initiative, skill and 
understanding of the student could be tested more effectively and to the 
satisfaction of both the student and the teacher if the student's performance 
is assessed as he performs each experiment during the course, the result of 
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each assessment being made known to him then and there. Since the assess¬ 
ment is done in the presence of the student, he is made fully aware of the 
mode of assessment as well as the result of the evaluation. This procedure 
will make the student aware of his day to day progress in his laboratory 
course and hence provides him with ample opportunities for improvement 
and adjustment. In this process, the examinations form part and parcel 
of a highly coordinated plan of instruction and supervision throughout the 
educational career of the student. 

In order to ensure a certain degree of uniformity in the mode of assess¬ 
ment which is essential in the case of affiliating universities, it could be 
arranged to have inspection procedures by which the mode of assessment 
could be controlled. Also, if necessary, viva-voce examinations could be con¬ 
ducted at the end of the course which would serve as a guide to both the 
instructor and the student, and the performance of the student in the viva- 
voce could be given certain weightage in the overall assessment. Oral tests 
have their usefulness in determining the ability of the students in express¬ 
ing correctly and fluently and understanding properly the subject matter. 

The success of this system depends on certain important pre-requisites 
which should be provided and without which the system is bound to fail. 
They are summarised below : 

1. No educational system can be a success unless the teachers and 
administration want to make it a success and strive hard for its suc¬ 
cess. This requires a high sense of devotion, a high degree of per¬ 
sonal integrity and a love for the profession. 

2. The laboratories should be equipped adequately and facilities 
should be provided for the students to work individually or in batches 
of two. 

.1. Experiments should be properly designed to make them interesting, 
challenging and rewarding to the student. 

4. Make laboratory an optional course for those who wish to remain 
in scientific and technological fields. 

5. Senior teachers should be incharge of laboratory instruction and 
they should supervise the laboratory work of the students. 

6. Instructional load in laboratory should be given the same weightage 
as theory classes. 

7. Adequate staff should be provided to carry out the laboratory work 
efficiently and in time. 

8. The senior teacher who supervises the assessment of the student in 
his laboatory work should maintain progress card for each student, 
a copy of which should be made available to the student. 
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Dissertation and Viva Voce 


G. N. TANDAN 


The facility of thesis or dissertation written under the guidance of Profes¬ 
sor, Head or Teacher of the Department of many subjects in the Faculties of 
Arts and Commerce exists for those students in most of the universities who 
secure 55% marks in aggregate at their M.A. and M.Com. Previous examina¬ 
tions. Although the coverage of the dissertation is confined to local conditions 
of the area, in many cases it does not bring new facts and observations. This 
facility creates resentment among non-thesis students because very high 
marks obtained in thesis discriminates against their all-the-year studies in 
other regular papers. 

Similar injustice and academic discrimination are resented in the case 
of viva-voce examination at M.A. level. The v/ifl-voce examination extend¬ 
ing to hardly ten minutes has outlived its utility because of very high marks 
awarded which are disproportionate to the theory papers. This has com¬ 
pelled many of the State Public Service Commissions to deduct the viva 
marks from the academic performance for calculating the percentage. This 
synthetic support to the division at the postgraduate examination should be 
stopped. 

The practical examinations also cannot claim impartiality and acade¬ 
mic justice with regard to science examination where most of the students 
pass in practicals but fail in theory- 

introduction of M.Phil. after M.A. and M.Com. which enables the stu¬ 
dents to undertake training in the methodology of research will help in keep¬ 
ing the advantages of thesis and at the same time doing away with the dis¬ 
advantage of the facility of thesis which should be stopped. 

It is, therefore, suggested that the facility of thesis, viva-voce and 
practicals be stopped or replaced by only acceptance of thesis without marks 
and pass or fail in the practicals. Hiis will not only remove injustice and 
discrimination but will also retain the academic utility of the thesis and prac¬ 
ticals. 



Viva Voce 


MOHAN LAL 


At the postgraduate level, where a candidate specializes in one discipline, 
viva voce forms part of the examination process to evaluate the worth of the 
examinee. 

Since the viva voce ranges all wer the various branches of the subject, 
it should take place immediately after the written papers when the examinee 
is still “full of the subject” and is keyed up to high effort. 

Viva voce is a necessary supplement to the written examination. To 
prepare himself for the written examination, the candidate may have con¬ 
fined himself to a small sector of the course, concentrating upon the “expect¬ 
ed questions": he may have read widely but without understanding; he may 
have crammed up “facts and figures” and “quotations” anil may have failed 
to appreciate the necessary correlations; he may have used unfair means at 
the examination. A skillfully conducted viva voce test is expected to expose 
the extent of the area and the depth of ignorance and also of attainment 
of the examinee. 

The true purpose of the viva voce in the examination process can only 
be realized through proper viva voce examiners. The viva voce should never 
be conducted by a single internal or external examiner. The single internal 
examiner, conducting viva voce alone may find himself, in the present condi¬ 
tions, subject of very unhealthy pressures. The single external examiner 
drawn from another university may not be familiar with the range of courses 
at the university and the level of attainment expected from the candidates 
in the several branches of study in the subject. 

The selection of the examiners should be made with great care. A 
subject usually has several fairly specialized branches. The appointing 
authority must take care to appoint two such examiners, one external and 
one internal, who would, between the two of them, be able to examine the 
true worth of the candidates meaningfully on the various branches of 
the subject which the candidates have offered. 



I suggest thut the bodies recommending names of examiners to the 
appointing authorities should be called upon to furnish a certificate that 
the members of the viva voce board recommended by them are competent 
to evaluate the attainment of the candidates in the branches of the subject 
in which the candidates are to be examined. 

The viva voce programme should be drawn with care to ensure justice 
to the candidates. Examination of thirty candidates in one day of or 
8 working hours will ensure 15 to 20 minutes for each candidate, viva voce 
as a test method becomes a farce when a candidate is “disposed off” in less 
time. 

It is necessary that the number of candidates to be examined by one viva 
voce board must be limited—120 is a good number, involving 4 days of 
work, for, an external examiner called upon to stay for longer duration is 
likely to refuse. The viva voce examiners should be called upon to certify 
that they actually sat and conducted viva voce during the entire period of 
time prescribed in the programme. 

Some scheme of evaluation of the performance of the examiners at viva 
voce is required. Tabulators and Registrars, noting serious imbalance 
between the marks in written and in viva voce examinations, may draw the 
attention of the Vice-Chancellor, Results Committee, Board of Studies, 
Faculty Board and the Academic Council; viva voce examiners may be call¬ 
ed upon to explain their methods and justify their valuation. Precise rules 
and procedure for all this can be worked out and provisions for punishment 
made. 

Inisiructions may be drawn up for the viva voce examiners explaining 
the purpose of their inquest into the candidate's knowledge, and depending 
upon the subject, methods and techniques they may adopt in their work. 
A perfunctory report of two or three sentences, so often made by the viv a 
voce examiners, may not be considered adequate, and a detailed proforma 
for their report can be drawn up and prescribed. However, the best correc¬ 
tive lies in the appointment of suitable scholars as viva voce examiners, and 
conversely, removal of those found inadequate to the task. One of the pur¬ 
poses of the above procedure is to highlight rhe inadequacy to facilitate re¬ 
moval. 

The viva voce should carry the same weight as a question paper in the 
written examination, i.e. when the examination comprises of 4 or 5 written 
papers and a viva voce, with each paper carrying 100 marks, the viva voce 
should also carry 100 marks. 

For cultivation of objectivity. I think, instead of awarding marks in 
one lump at the end of the viva voce of a candidate, the examiners should be 
instructed to determine categories with certain percentage of marks assigned 
to each, for example, in viva voce in Political Science, in the total of 100 
marks, 20 may be assigned for the range of course covered by the candidate. 
20 for comprehension of facts, 20 for understanding of ideas, 20 for logical 
analysis, 20 for recognition and understanding of the essentials. It is not 
fair to award marks on the basis of a preconceived notion of the candidates 
ability on the part of the internal examiner which all too often influences the 
external examiner. 

Now, if is true that viva voce, or any other form of examination, is 
productive of strain, tension and stress on the part of the examinee which may 
adversely eflect his performance. But. then, all candidates are subjected to 
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equal strain, tension and stress, and part of it is unavoidable under any test 
condition. As far as possible, the rigour may be mitigated by conscious 
effort, but it can never be mitigated. In fact, high performance is high ten¬ 
sion. 

The university should indicate the exact hour for the viva voce for each 
candidate, with a margin not exceeding half an hour, waiting consumes 
nervous energy. Comfortable waiting rooms for boys and girls with drinking 
water and washing facilities must always be provided. Viva voce of girls 
should not be scheduled after sun set. The examiners should be courteous, 
avoid sarcasm, or effort at humour or familiarity with the candidates, they 
should place the candidates at ease by providing them seat and acknowledg¬ 
ing their salutation, but maintain their distance due to them as examiners, 
and give the candidate time to collect his thoughts and phrase his answer. 
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Examination Reforms 

M. B. ARIYAPALA 


Changks and modifications in the present system of examinations have 
become a vital necessity today. This is due to the importance attached to 
the university degree in the social andeconomic context and this has made 
the students Teel that success at the examination is the one goal of university 
education. The decision as to whether a student should be awarded a 
degree or not becomes a very serious one. The degree is one that will affect 
the whole future of a student. At the personal level it often determines 
whether he will consider himself a failure, while in the employment market 
it has lasting con.scquences.* This is indeed why the examinations have 
become of such vital importance today. Hence, it is our bounden duty 
to look into the ways how assessment of students is carried out, with a view 
to ascertaining their validity and reliability and also seeing whclher they 
fulfil their functions adequately. 

Examinations have to be designed as to correlate the teaching and learn¬ 
ing objectives. At this point, I wish to draw the attention of the Conference 
to a very valuable observation made by Dr. Bloom and quoted in the Re¬ 
port of the Committee on Examination Reform—1969, University of Indore: 

‘Personally, I do not believe that students can learn a complex uni¬ 
versity subject without devoting time to it. University learning is a full 
lime activity and should, in my view, occupy as much of the students’ time 
as a regular occupation 40—50 hours per week. Less time than that must 
mean that the work is not of university standard or the student is gaining 
only a superficial understanding of the subject. 

While 1 have been primarily concerned about the complexity of the learn¬ 
ing and the work required, it seems to me that some of the disciplinary prob- 

*M. Ager AWeltman—The present structure of University Examinations—^Universities 
Quarterly, June, 1967. 



lews in Indian universities must arise from the sheer amount of time avaii- 
able to the student for “non-intellectuaJ pursuits”. On a sheer probabihly 
basis the student who spends onJy 20 hours a week in inteJIectual activity 
is going to get into more “non-intellectual” activity than the student who 
spends 40 hours a week in intellectual activity. However, this should not 
be interpreted as a plea for mere filling of time for disciplinary reasons. 
The point is that time is required for a significant educational development 
in the student'. 

This is indeed something that aifecls us vitally, particularly in pro¬ 
moting the studies in the arts faculties. This has become specially signi¬ 
ficant with the introduction of the Swabasha media. This seems to involve 
us in finding some form of replacement for the erstwhile reading habit, 
which will be an inducement for productive original work—creativity being 
of particular significance in the present academic context. 

In view of the foregoing it is not out of place here to consider the func¬ 
tions of examinations. Dr. Lovell gives the "alleged" functions of exanti- 
natioiis as follows: (I) To prevent nepotism. 12) To test if the student 
has acquired a certain amount of knowledge; also whether he understands 
and can relate the various aspects of the body of knowledge studies. (3) 
To maintain academic standards. (41 To progno.slicale in the sense that 
G-C-E. 'A' level evaminalion icsiills are regarded as evidence of siiilabililv 
for entrance to a universily course and iheclas.s of university degree is looked 
upon as an indication of competence in a chosen occupation. (5) To lest 
qualities such as intelligence, industiiousness. perseverance, stability of 

temperament, docility to di.sciplinc. calmncs,'. under stress, etc.(6) To 

provide an incentive for students and the teaching sialT. (7) To check on 
the understanding of students, so enabling the teacher to iir prove the cflcc- 
livcness ofhis method.s. (S) To providca means ol'.social engineering in that 
cxaininalioiis appear just, bul can nevertheless regulate the flow of enirams 
into educational courses and occupations. 

One inay perhaps be able to add to these functioits, anollier ma> ic~ 
quire the deletion of some of them. One may even raise the question why 
hold examinations at all and whether the I'unclion.s or aims of examinations 
could not be achieved by other means. To answer all these, one has. it 
is needless to say. to investigate the shortcomings of the system prevailing 
at present. 

Our attention is drawn by Ager and Weltnian to amitlier important 
function of exams, and this function we have all along tended to overlook. 
“Another function which examinations could fulfil is In act as a guide In 
students on their progress. Unfortunately, however, students tire often 
given too little information about their performance to benefit in this way". 
This is indeed a very important aspect of examinations from the point of 
view of the examinees. I have always felt that students should be allowed 
access to their marks and grades. This information, if given to the studcni. 

I believe will be of immense help and guidance in their studies. In our 
universities the grades of the first examinaljon are given to the students, 
while their performances in the final are withheld from them, only the 
result being announced. Now that the final examination has been divided 
into two parts, I hope that the gradc.s and marks of Part I of the examina¬ 
tion will be available to the students. This is an aspect to which the autho¬ 
rities must give due thought. 
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OUR EXAMINATION 

Upto last year our examiuaiions were of the traditional essay-type, 
but I must add that the system and techniques adopted by us have proved 
fairly satisfactory. Nevertheless the need for reforms has been felt and 
attempts have been made to effect modifications and changes. 

THE PRESENT POSITION 

(fl) Setting of paper ; Our essay-type quesion paper (specially in aits 
subjects) is a composite one and ensures coverage of the syllabi. Students 
are normally given about 10 questions, out of which they are expected to 
select 5 and sometimes 4. The paper is set by two examiners who have been 
leaching the subjects or parts thereof. In the absence of two leaching a 
subject, a competent teacher is selected from amongst those who have a 
knowledge of the field covered by the paper. When more than one lecturer 
IS involved in the leaching of a particular field of study, e.g,, prescribed 
te.xts, the lecturers concerned are normally requested to hand over to the 
examiners concerned a few questions on the part of the course covered by 
each of them. The two paper setters are at liberty to select whatever ques¬ 
tions they think suitable or to accept theni in a modified form or to reject 
them if they deem them unsuitable. The question paper tints •'Ctis gone 
through by the head of the department who is the chief examiner in the 
subject. The paper as decided on by the head of the department and 
the two examiners concerned is passed on for moderation to the external 
examiner from another university in Ceylon itself or outside. When we 
have received his comment.s and observations the papers are passed on 
to a board of scrutiny, which is expected to fintilize the paper. This Board 
normally includes the dean of the faculty, the head of the dcpurimenl 
and one or two other members of the faculty whom the faculty thinks has 
competence in the field of study. 

With the introduction of the Svvabasha media we hate had to set 
question papers in the Sinhalese mediunr as well as in the Tamil medium. 
The responsibility of selling a paper thus fell on the lecturers who lecture 
through the media. In such cases the question paper is normally set in the 
English medium, as it is the medium common to both lecturers and the 
question paper is then translated into the other two languages i.e. Sinhalese 
and Tamil. Though lecturing is done in the arts subjects in the Swabaslui 
media, we have been able to send the question papers that are set in English 
to external examiners even in U.K. This practice has helped us to main¬ 
tain standards not only with universities in Ceylon, but also with univer¬ 
sities outside. 

In the essay-type question papers that we deal with, it has been observed 
that correlation with some of the instructional objectives such as the "appli¬ 
cation of knowledge to problems", "evaluation and creativity" have not 
been very much achieved. Though care is taken in setting the paper to see 
that questions of the type that lend themselves to the display of this ability 
of a student and application of his mind are set, yet it is our experience that 
most of the students seem to be satisfied with the mere communication 
of facts and data that have been collected. It is seldom that a student 
displays his ability to discuss and analyse a problem. This is one of the 
aspects of the question paper that we in Ceylon have to pay attention to. 
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It also has been noticed that students attempt to choose questions that 
permit them to pour out their crammed up Facts and avoid questions which 
involve any kind oF creative thinking. It is obvious here that one has to 
take necessary saFeguards in setting the paper to see that this kind oF thing 
does not happen. One method oF partially achieving this objective will 
perhaps be to curtail the choice given to the students. A comment made 
by J.W. Saunders* seems to the point, even though it relates to another 
sphere oF education. 

“.It is particularly undesirable For the...examiner to 

set questions which demand a knowledge oFa high proportion oF specialised 

Facts.Adult examinations ought to be unprofitable to the “crammer” 

.The only reliable way to circumvent prepared surFace who is 

to ensure that the questions will tax the judgement and exercise the critical 
Faculty, preFerably in matters that have general human importance and 
validity.adult examinations depend For their value on eliciting judge¬ 
ments about humanity.The emphasis ought not to be. Can you 

remember what you were taught? What were the Facts in this case? In 
what order did these events occui? A better emphasis is : What do you 
infer from these facts in this order? In your experience is this true? How 
do you connect these apparently diverse elements of human experience? 
Once the adult student has learned that all facts are not of equal value, has 
become acquainted with the university habit of treating each set of fads on 
its merits, has distinguished a false inference from a just, he is ready to 

advance.into the province of judgements and values, and the good 

examination paper exercises him in this growth '. 

Dr. Lovell’s remarks on this aspect are also noteworthy ; 

“Moreover the most reliable essay-type questions are those ihiil pose 
a definite problem and give the candidates a clear indication of what the 
examiner is looking for. Such questions do give the candidate scope 
for marshalling and organising his material. The rather \ague open 
type of questions may give'the candidates greater freedom in respect 
ofthe groLindthey cover and in their approach, but it makes comparisons 
between them very difficult. Most university and college teachers 
can, as a result of talking with their students, seeing their course work 
andthrougli previous experience of examining, rorescc the kinds of ans¬ 
wers they will get. In these circumstances quetions are likely to be free 
from ambiguities, at about the right level of difficulty, worded so that 
different candidates can be compared and marked consistently while at 
the same time they will further the abilities and knowledge the examiner 
is attempting to assess.” 

(b) Assessment of scripts '■ Criticism has been levelled against the 
methods of assessment and evaluation that are being practised today. II is 
left to us to devise ways and means of overconr.ing shorlconvings that have 
been highlighted in connection with the assessment of our answer scripts. 
The main problem is the achievement of a contmon standard among the 
number of examiners who are called upon to assess the answer scripts. 
The difference of opinion amongst examiners about the relative value of 
a student's answer seems to be a chief source of the unreliability of our exa¬ 
minations. This difference oFopinion could result front a number of causes, 
e.g., a different examiner may look for different things, one may value know- 

* Adult Education Papers, University of Leeds, 1954. 
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ledge of facts or grasp of general principles, one originality of ideas, anotfer 
clarity of expression. The most dangerous in this aspect, in my opinion, 
is the expectation quite often of examiners to find their own viewpoints and 
pet themes and ideas embodied in the answers. The students are quite 
tempted to cater to this weakness on the part of examiners. 

The system adopted by us in the hope of eliminating as far as possible 
the weaknesses that have been stres.sed above is to obtain the services of two 
marking examiners who would mark the scripts independently of each other. 
For quite a long time we have had an internal examiner and an external 
examiner for each paper. This practice of having external examiners too has 
helped us in maintaining standards, between the universities as pointed out 
in the above section on setting papers. It was the practice with us sometime 
back to send marks of the internal examiners to the external examiners; 
but We have now modified this practice and seek two independent markings 
both of which may be internal assessments. The year before last, I had a 
case where there was a wide gap in the assessment between the internal and 
external examiners. In this particular case it was not difficult for us to 
dispense with the services of this particular external examiner who was 
found to be far too lenient in marking the scripts. It has not been the prac¬ 
tice to impose penalties for such faulty evaluation. In fact even if we do 
have a code of penalties it will not be easy to punish an external examiner. 
The only remedy that is left to us is to discontinue the services of such exa¬ 
miners. In the assessment of a paper we have been in the habit of averaging 
the marks of the two examiners. As the degree examination consists of a 
number of papers it has always been possible to check on the performance 
and hit upon a fairly correct assessment of the student. 

It is true that we have a fairly comprehensive scheme of marking and 
grading: but it has been dis-hearlening to find that the achievements of stu¬ 
dents very seldom or rarely reach even a second upper standards, specially 
in the general arts degree. Whether this position is the result of bad 
material, faulty examination system or unproductive study habits or all 
these is a matter that we should take serious note of. 

Roy Cox in his Survey "Examinations and Higher Education" points 
out that “various attempts have been made to improve reliability such as 
increasing the number of markers, of devising more rigorous techniques of 
marking but these have not met with a great deal of practical success”. 

Roy Cox refers to 3 obvious ways of attempting to improve the reliabi¬ 
lity of essay-type exams: "One is by increasing the number of markers so 
that the marks each candidate achieves are the average of a larger number; 
another is to devise systems whereby marks can be allocated for particular 
points in a more controlled way. The third is to increase the num.ber of 
questions” (ibid p. 302). He further warns that “The improvement does not 
represent greater agreement on the value of the essays; it is merely a devise 
foi getting the sam.e mark every time” (p. 303). 

Quite recently we too resorted to the former and attempts were made to 
gel one paper marked by a number ofmarking examiners where the question 
paper consisted of a number of parts. Markers competent to mark the 
relevant parts were commissioned to do this, and I must say that this too 
has helped us to a good extent in the elimination of the subjective elem.ent 
which is considered by many as a source of unreliability. 

To get over the problem of different examiners looking for different 
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things, arrangements have been nude for the paper-setters to discuss the 
question paper with the co-examiners before marking is started upon. The 
paper setter is sometimes requested to formulate briefly his answer to a ques¬ 
tion he has set and this is normally discussed at the pre-marking conferences 
mentioned above. In addition to this practice, the chief exam iner in a 
paper going through a few pilot scripts of each of the other examiners has 
also been adhered to. The adoption of these measures in themselves could 
not in any way be said to be a sufficient safeguard against divergences in 
marking. Other ways and means will perhaps have to be devised in the 
light of experience. 

After the scheduling of marks, border-line cases are reviewed. 40 
is generally accepted as the pass mark and answer scripts of those Who 
have obtained 37, 38 and 39 are always reassessed by the chief examiner in 
the subject, either on his own or with the assistance of one or two of his 
colleagues. Our objective here is to decide whether the student deserves a 
pass or not. When all the marks have been scheduled, a meeting of the 
Examiners in all subjects is held and it is at this meeting that“passes” and 
“failures” are ultimately decided. At this meeting the examiners very 
often take a very sympathetic view of students’ bad perfornunces and more 
often than not increase the marks of such cases, when their performances in 
the other subjects seem satisfactory. Thus we have been able to reduce 
the wastage. 

GIUDINC 

In marking papers it is our practice to give a numerical mark and mark 
to a pass of 40%. The marks are then categorized into grades. We arc 
always conscious of this grading and this is seen from the fact that at the 
meeting of examiners, we do notjumpfrom one grade to another even when 
the case that comes up for consideration is a case for reference. One could. 

I believe, be nearer the target With a grade than with a numerical mark. 
Hence my contention is that grading should be recognised and giving nume¬ 
rical marks be done away with. Number of papers submitted to the last 
Conference at Madurai, recognised this fact. Just as any device adopted in 
the process of assessment has its shortcomings so may this have. Dr. Lovell 
observes: “This gives a relative standard based on the performance ol 
average groups of students rather than on supposedly absolute standards, 
but studies have shown that variability between examiners is sometimes re¬ 
duced using this method. Once again there are difficulties in using the 
method. For example, while it is a form of ranking a grave defect is that 
one script is not usually compared directly with the scripts ofother students 
before the grading is made; as the experience ofwhat one examiner considers 
to be ‘A’ differs from the experience of another, their standards will continue 
to vary; and grading is relative to the group of students examined”*. John¬ 
son and Abrahamson in their article “The effects of grades and examinations 
on self-directdedlearning”t have examined the effects of a grading .system on 
their students: "The staff of the University of Southern California, School 
of Medicine were concerned that their students were far too exam, oriented 

•University Teaching in Transition pp. 143. 

f Journal or Medical Educallon. 1968—Abstracts—Research into Tligher Education 
Vol. 2, No, 2,1968. 
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and not sucfficiently interested in learning for its oWn sake. The number of 
infernal examinations was therefore reduced and the previous more specific 
marking system was replaced by descriptions of performances in course- 
work plus gradings of “satisfactory” or “unsatisfactory” for each course 

.it did appear that changes in the desired direction had taken place 

and that such p henomena as cramming for examinations and cutting classes 
not concerned With examinations had diminished”. 


vivA-VOCE EXAMINATIONS 

Viva-voce examinations have not been generally (except in the field of 
Medicine and at post-graduate level) a part of our examinations. In the 
arts subjects it is only in the modern languages such as French, German 
etc., that we have a viva-voce examination. In the past vivas formed a 
chief element in the selection of students for admission to our university: 
but were soon given up. Somehow or other the people in Ceylon do not 
seem to have much faith in viva-voce examinations. The criticism of 
unreliability that is levelled against an essay-type examination could be 
levelled against viva-voce examination as well. It is also doubtful whether 
student's abilities that cannot be validly assessed by objective type examina¬ 
tions could be validly assessed by oral examinations. Tv\o researchers. 
Colton and Peterson in this field have shown* that despite the careful selec¬ 
tion of teams of examiners, reliability varied greatly among them. 

CONTEMPLATLD MODIFICATIONS 

(a) Objective type examinations: The Department of Education in 
Peradeniya, I gather, has been for sometime now using the objective tests 
to some extent. The question of introducing the objective type of questions 
and giving more and more weighlage to internal continuous assessment are 
now being considered by the other faculties of our universities. It was 
only within the past yearlhat objective type questions were brought into the 
system of the examinations of the Faculty of Medicine. The other facul¬ 
ties are now considering the introduction of this type of question. The 
objective type questions also hav e disad\anlage.s as much as they have advan¬ 
tages. Dr. Lovell refers to more disadvantages than advantages. 

ADVANTAGE.S 

1. Marking is objective and takes little time. Papers can be scored b\ 
machine. 

2. A thorough coverage can be made ol'lhe syllabus since large number.s 
of questions can be set and 100 or more per hour may be answered. 
This wide sampling of the candidate's knowledge makes for high 
reliability. 

.1. Candidates spend their time thinking and not writing. 

4. If the question.s- cover all levels of difficulty evenly then the mark 


*Jouraal of Medieal Education. 1967; Research into Higher Education— .Abstracts - - 
Vol. 2, No. 2, 1968. 
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distribution will approximate to a normal one and it can easily be 
converted to any other scale. 

disadvantages 

1. Setting the paper is a skilled job and needs considerable experience, 
ir the test is badly constructed it will not bring out the capacity to 
interpret or apply principles. A well constructed test can do this. 

2. The examination papers take a long time to set. Moreover, the exa¬ 
miner’s opinion as to what is to be examined in detail enters into the 
setting of the questions. In this sense they are subjective. 

3. A considerable amount of reading is required from the candidate. 

4. Unless care is taken they can be somewhat artificial in their phrasing. 

5. Certain irrelevant factors such as the examinees’ previous acquain¬ 
tance with this type of test affects performance. Thus experience in 
manipulating one’s knowledge to the requirement of the medium 
is an advantage. 

6. No account is taken of the candidate's capacity for lucidity of expres¬ 
sion. If this is to be examined separate papers cun be set for this 
purpose. 

One disadvantage envisaged by us is the difllcully in setting objectise 
type questions. As Lovell points out. setting objective question papers is 
“a skilled job and needs considerable experiences". It is also doubtful whe¬ 
ther some fields of study would lend themselves to this kind of examinations. 
The diagnostic nature of an objective paper is an advantage in judging 
the level of students’ ability. Dr. I ovell's observation,? regarding the objec¬ 
tive and traditional essay-type examinations arc worthwhile noting: 

“But it is wrong to assume that the objective examination is neces¬ 
sarily a more satisfactory instrument. It may be a more convenient 
method of examining with large groups and it may be highly reliable. 
The reason that some objective tests are lieitcr than some traditional 
ones is that the latter are often set in an unsystematic manner and subject 
to chancy moderation by a second examiner. An objective type exami¬ 
nation must be well designed or it will be a less satisfactory tool than a 
conventional paper drawn up by an experienced panel and marked on a 
systematic schedule. Both kinds of examinations can be used with 
profit in order to improve the efficiency of the examination system ". 

tb) Coniifiuoiis assessment: Continuous assessment has now been 
accepted more or less by everybody concerned with higher education as a 
most desirable and essential part of student assessment. Sometime back 
we practised a semblance of this method in reviewing the border-line cases. 
In considering whether a border-line case should be passed or failed, his 
performance at tutorials was considered, and the student was passed or 
failed accordingly. Even this was relegated quite a while ago, to the limbo 
of forgotten things. But now there is an awakening of interest as regards 
the question of continuous assessment, and there is general agreement that 
it is a must in the evaluation of a student. M. Ager and Weltman referred 
to above argument that assessment of course-work provides the most 
“valid” test of the achievement of higher education’s aims. Much has 
been said about the effectiveness, reliability and validity, etc. of this system 
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of assessment, and one has to admit that continuous assessment will have a 
most desirable effect on the student. This system is bound to ensure regu¬ 
larity and sustained study and this will undoubtedly help in the creation 
of an interest in one’s studies, and will also bring about a salutary change 
in the methods of study adopted by students. 

As far as we are concerned, attendance at tutorials (lectures are not 
compulsory) has always been a troublesome question. Students have been 
and are too much in the habit of cutting tutorials. The head of a depart¬ 
ment has to certify that a student has put in eighty per cent attendance at 
tutorials, if he is to be permitted to sit in an examination. With the introduc¬ 
tion of system of a continuous assessment all these problems that vex the 
lecturers and I believe even the students will disappear. As to the methods 
and techniques that should be adopted could best be decided on by each 
individual university. We are already working out a system for ourselves. 

(c) Slatidardisaiiott: A system of standardisation has been suggested 
and is also being followed by the Ceylon Government, Department of Edu¬ 
cation as a means of adjusting marks to a common standard deviation. The 
Education Department is using .some form of standardisation in finalising 
their O.L. & A.L. results. The universities, however, have shown much 
reluctance in accepting this method of striking a common standard. In 
Ceylon, at the moment there is an uproar against the adoption of this system 
to decide on admissions to the institutes of higher education. The following 
comment by an ex-professor of the university appeared in the Ceylon Daily 
News of 2nd December; "The admission of handicapped students on a basis 
of standardisation is not going to help such students. The majority of 
such students will continue to be backward after admission, for the reason 
that they will not be able to catch up with the students from the better 
schools”. The Editorial of this daily paper makes the following comment 
on the situation now facing us; "This is a question which is also a manifes¬ 
tation of the same dilemma of the just distribution of scarce resources in 
conditions of limitless demand and of attempting to equalise opportunity 
in a situation of evident inequality". 

This in brief shows Ceylon's attitude to standardisation :but a situation 
1 am compelled to admit, where one has to make a case for some form of 
standardisation has arisen in the university today. 1 refer to the diver¬ 
gences in marking in the two media, Sinhalese and Tamil in which languages 
students answer their examination. It will be necessary in this connec¬ 
tion to accept some form of standardisation as the only means available to 
us now, to obtain a common standard between the two media, and tf.ertby 
remedy and variabilities if any, in the marking. 

CONCLUSION 

Considering the foregoing observations, I wish to conclude by stating 
that we in Ceylon, are working towards an examination system which will 
involve traditional essay-type question.objective multiplelype questions and 
continuous assessm.ent. We thus hope to strike a harmonious blending of 
these methods which will I hope result in a more valid and reliable student 
evaluation, promote better study habits which will raise the levels ofperform.- 
ances and ultimately lead to the achievement of excellence. 
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;ie:orms in examination System 

SARANJIT SINGH 


student’s attitude and teacher's reaction 

Whatever PLAN we may make, it will fail at ilie implemcjilaiion stage, 
unless the persons who are going to implement it keep the objectives in 
view. For instance, one hears a general complaint these days that lot of 
unfair means are used by the candidates at the examinations and it has 
been advocated that there should be strict invigilation. We may increase 
the number of invigilators, but unless the invigilator realizes the full res¬ 
ponsibility entrusted to him, and is prepared to discharge the same faith¬ 
fully, the increase in number is not going to be of any help. I may cite 
another example. Reports have often appeared in the. papers that at some 
centres the invigilators have been threatened for carrying out their duties 
conscientiously. As a remedial measure, it has been suggested that legal 
protection may be provided at the centres. This does not solve the problem, 
because the invigilator still runs a great risk in his normal life. Willi this 
fear in his mind, he may still find it a safer course to keep his eyes turned 
away from the examinees using unfair means. As such no incident will 
be reported and everything will look satisfactory on paper and the facts 
will not come to surface. I agree that we should not be misled by a few 
such instances which do get publicity and things may not be as bad at pre¬ 
sent as we may imagine. But this is an indication of the worsening trend 
and it won’t be long when invigilation will be a complete farce. Quite 
recently the result of one examination of a professional college has been 
declared void after necessary investigation of the facts. Such things may be 
in their intitial stage at this time, but unless timely action is taken, the 
conditions are likely to deteriorate beyond a point of no return. To me the 
whole problem appears to be a part of a wider complex and is not confined to 
the system of examination only. It is a reflection of the general attitude of 
the public to social, economic and political values. My apprehension is 


that after sometime the students are bound to ask for a pass even without 
any examination. This may sound odd now but it may not be so after a few 
more years if We consider the Way the conditions are getting out of hand. 

These days students are being associated with lot of activity in the 
universities which is a very desirable thing. The unfortunate part of the 
whole process is that the students have gained these objectives (which are 
only a small part of the total objectives) after an agitational approach 
occasionally leading to violence, loss of property and disruption of normal 
life. This has set a bad precedent and in future we are going to witness fre¬ 
quent repetition of these methods. The academic community must realise 
that as far as academic matters are concerned the role of the students should 
only be advisory. It will not be wise to give them power on decision making 
bodies at this stage. I may not be wrong in assuming that some of you might 
be inclined to consider even these demands of the students with sympathy. 
This may be the logical things if the conditions were ideal, but as everyone 
knows they are not and as such it will be detrimental to place power in the 
hands of the students. But will the academic community be able to hold 
its own or swim against thecurrent of popular demands. Tome this appears 
possible only if there is an organised attempt to generate public opinion to 
highlight the advantages and disadvantages of a particular proposal. This 
will be a difficult course as opposed to a simpler one i.e., to swim with the 
current. The choice is left to you to bear this in mind while considering the 
different aspects of the e.xaminalion system. 

M\.SS fducatio.n and .academic .standard 

The academic community finds itself at cross roads. On the one hand 
they liave to deal with the demand for mass education and on the other 
hand they are concerned with the improvement of the academic standards. 
The two things cannot go side by side. If the standards have to be raised then 
at some stage weeding out has to take place and this weeding has so far 
been decided on the basis of the examination. In this process the academic 
eomnvimily comes for criticism on account of vvasteful expenditure. The 
re.sult is that the teachers and the examiners adopt permissive attitudes like— 

"why should 1 harm any one or why should I get the curse.With 

this background the marks arc sometimes awarded indiscriminately to com¬ 
ply with certain rules either to pass the candidate or to enable him to get 
another chance. This is not conducive to raising of acadenric standards. 

A SUGGESTION 

To overcome this situation 1 here venture to put forth a bold suggestion 
for consideration. We may hold the examination but noi to declare pass 
or fail. After all in the examination we determine the relatb e performance 
of the student on some arbitrary scale in a particular set of conditions and 
this should be indicated on the certificate awarded by the university at the 
end of the course. For instance, it may mention the number of students 
appeared, the rank obtained by this candidate, the maximum marks obtained 
by any candidate and the marks obtained by this candidate, etc. This 
will depict a relative performance of the student in that university or institu¬ 
tion and whoever is concerned will form his own opinion and treat the 
information in a manner that suits him. Further, if a candidate likes to 
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improve his performance, he could reappear in the whole examination and 
get a chance to improve his grade. With this approach the universities will 
meet one great objection from the public without compromising with stan¬ 
dards, and that is the wasteful expenditure on failed students. Now it will 
be upto individual student to spend more time, if he has the resources to 
undergo another year/6 months of teaching in order to improve his per- 
formace. This will help in the raising of standards without prejudicing 
the student’s future. This approach may be alright where the individual 
is judged by another person in his later career. However things will be 
different in the case of a professional student. For instance, take the case 
of medical student. Here a student may go out without acquiring profes¬ 
sional ability and skill. If he starts his own practice it might be dangerous 
for the public. You may say that it is for the public to assess the practi¬ 
tioner, but it will be too difficult for a layman to assess professional bodies 
who should give license for professional work. This Will safeguard the pub¬ 
lic interest. 

I do realise that it is a very radical suggestion and many of you may like 
to reject it straightaway. But 1 would request you to consider it objectively 
and dispassionately and then take whatever decision is considered best 
under the existing conditions. Mere tradition should not be allowed to 
overwhelm our thinking to an extent that it retards progress. 
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Centralised System o: Examination 

V. S. MISRA 


IN THE CENTRALISED system of examination the same test is adminis¬ 
tered to the students taught the same syllabus in different institutions. Most 
of our university examinations are of this type and they are mainly in view 
in the further discussion. The weaknesses and strength of the system have 
been discussed in other papers. The present paper is therefore limJted to 
three major problems of the system. 

MAINTENANCE OF EDUCATIONAL STANDARDS AND CHECKING OF FAILLUE RATES 

Some people complain that the standards of university education arc 
falling; others have just the opposite view. These views are mostly based 
on subjective judgements. We need some studies to investigate whether 
the standards have really deteriorated. If so, what are the reasons for the 
deterioration and what could be the remedy. The standards cannot be 
raised by the efforts of the examining bodies alone, Active cooperation 
of teachers, students, guardians and employers is needed. For the present 
the steps that the examining bodies can take to improve the standards are 
to make the question paper more difficult and to raise the pass mark. Each 
of the above steps would increase the failure rates, which are already appal¬ 
lingly high.lt is therefore suggested that the examining bodies should 
immediately conduct the above-noted investigations and wait till thefind- 
ings are known. 

A related problem is the checking of failure rates. There could be 
several reasons for it: Students selected for the course are not fit to take 
it, The syllabus prescribed is not suitable to the group. Teaching is defec¬ 
tive. Learning is defective. Standards demanded from students are too 
high. In the absence of an impirical evidence nothing concrete can be 
suggested. However, one reason seems obvious. Most universities consi¬ 
der higher secondary school examinations as qualifying tests for univer- 



sify admission and graduation for postgraduate education. This is not a 
sound practice. Higher secondary, and graduation stages are complete 
in themselves with their own purposes. Hence it is suggested that examina¬ 
tion agencies should prepare special tests for selecting students. 

MAL-PRACnCES IN EXAMINATION 

If students do not answer questions independently, their marks cannot 
be considered valid measures of achievement. Thus, mal-practices defeat 
the very purpose of examinations. Further, these may develop into habit 
and this will have far reaching consequences on our national life. Several 
steps can be taken to discourage these practices; First, the failure ra tes should 
be minimised. When the chance of failing is high, students become des¬ 
perate. Failure does not mean only academic disapproval it means social 
disapproval too. We should make our examinations such that one who 
is regular in attending classess should be a sure case of pass. However, 
graduation should not be considered a ticket for postgraduate studies, 
or postgraduation for doctorate. As already stated, selection to a higher 
course should be based on a selection test. Second, we should not attach 
much importance to examination marks for selection to a post. All those 
who have passed the required examination should be allowed to appl)'. 
The merit of the student at the time of selection as judged by a board of com¬ 
petent experts should be the major criterion for selection to a post. Our 
giving much importance to examination marks hampers further growth 
of students. (Why should a first divisioner study? He has already a first 
divison. Why should a second divisioner study? No amount of further 
study will make him a first divisioner.) Third, we should enforce strict 
invigilation and deterrent penalty for such practices. 

SPEEDY PUBLICATION OF RESULTS 

The first precaution to ensure speedy publication of results is to mak^ 
the duration of examination reasonably short. For the present there exist 
long gaps between different papers of examinaton. One probable reason 
forgiving such gaps is to provide sufficient time to prepare for these papers. 
If examinations measure true learning, such gaps will be of little use for the 
purpose of preparation. It is therefore suggested that there should not be 
long gaps between different papers of examination. 

To ensure accurate and prompt tabulation of results we may use 
mechanical device. Most universities can afford to have a few card punching 
machines and verifying machines, one or two sorters and a calculator. 
With the help of these machines the tabulation work which is usually done 
in a week can be done in a day. (If we have access to electronic computers 
it is still better.) 

If the number of examinees is large and mechanical aid is not feasible, 
publication of results may be speeded by decentralisation of work. Exami¬ 
nation area may be divided into several zones, each under the charge of a 
zonal officer. Muph of the work that delays publication of results, e.g., 
distribution of scripts to examiners and collection thereof, checking and 
scrutiny of scripts, can be done at the zonal office. 
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"ne Semester System 

RAVI PRAKASH 


THERE ARE MANY arguments ill favour of the semester system as well as 
against it. Let us first consider the arguments against the system. 

The problem has been discussed in the report of the committee on 
University Teaching methods appointed by the University Grants Com¬ 
mittee of U.K. in 1964 slating that frequent examinations or assessments are 
a matter of different approaches of educational policies. The main argument 
was against the fragmentation a course which may prevent the students 
from understanding the subject or discipline as a whole. It can be argued 
that if a student studies a particular discipline over two years, his know¬ 
ledge of the discipline for the first six months of the portion he studies during 
that period undergoes a lot of change in depth as well as in broad implication 
when he reads the same portion by the end of the two years of his study. 

This will mean development of judgement and understanding of values 
along with maturity and breadth of vision. The report of the U.K., U.G.C. 
Committee took up this educational view that “it is only by examining a 
student in his most mature period over the whole range of his work as an 
undergraduate that a proper assessment of his quality can be obtained.'’ 

As against this view there are so many experiments in American Uni¬ 
versities where courses and even sub-courses are split up and the assessments 
are done of the portion taught and discussed over a period ranging from 
six weeks to 10 weeks. The educational argument in favour of this view is 
that at no stage can students be considered to be mature enough to under¬ 
stand all the implications of a discipline apart from the inter-discip linar y 
relations and certainly when he does different courses in his 1st, 2nd and 
3rd year and is asked to do the whole course at end of the three years he 
cannot be tested necessarily in a better way than through periodical tests 
throughout the course of three years of his instruction. The whole process 
of education is step by step and the courses can be so prescribed and or- 



ganised as to see that a continuity is kept in the areas from the known to 
the unknown. This will have the following advantages ;— 

(1) Avoid too great strain on students at the fag end of the session. 

(2) Lessen the burden of doing too many things at the fag end of the 
academic session. 

(3) Reduce the glorification of memory. 

(4) Provide motivation for the students to work throughout the year 
which is broken into two semesters. 

It will be seen from the above that for our conditions the semester 
system will be very useful if it could be properly worked. However, it is 
possible that the academic members of the university may not be interested 
about it for two reasons. Firstly, it is taxing for the teachers who have to 
work harder and,therefore it will mean addition of more teachers, particularly 
for tutorials and written work done by the students. Secondly, t le students 
themselves may be unwilling to work so hard as they are not used to do so 
particularly in the faculties of Social Sciences and Humanities. 

In that case the second alternative which 1 suggest is that the present 
university examinations at the end of each part, i.e.. Part 1, Part II and Part 
III, in B.A., B.Sc. and B. Com. examinations shouldbe modified. 

The suggestion is that there should be one university examination at 
the end of Part I which will be equivalent to the old Intermediate exam.ina- 
tion in Science, Arts & Commerce. This will mean an orientation to students 
to the college and university atmosphere. The students will be exposed for 
one year to modes of study required for university purpose as a transforma¬ 
tion from the school to the university. They will be made familiar with 
writing experiences and library studies and emphasis will be on self-study 
and original thinking. 

After this examination there will be an examination at the end of the 
3rd Part, i.e., after two years and at the end of Part II there will be a house 
examination for promotion. It will be recognised by the university but will 
be conducted by the colleges themselves. It is to be recognised by the 
university as Part II examination for the purposes of migration of .student.s 
to other universities. If all universities follow the same itiethod there will 
be no difficulties for migrating students. 

.After two years there will be one examination to cover the por¬ 
tion of the two years but 2/3 of the questions will be on the last year and 
1/3 on the earlier year. However, that will be a matter for the academic 
Iradies of the university to decide. 

In U.K. this system works very well because they have always felt that 
examining a student in most matured period over the whole range of work 
is a proper assessment of his quality. Moreover it will be seen that in the 
University of Lancaster, one of the latest universities in U.K., they have 
divided an examination in most of the subjects like for example in environ¬ 
mental sciences into two parts. Part I is the university examination at the 
end of the first year. Part II consists of courses of the second and third 
year at the end of which there is university examination. 

During these years the students have to be exposed to tutorials, writing 
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examination, different tests, both with notice and surprise tests, use of 
library and laboratories and encouragement of discussions in seminars 
and debates. 

The whole idea is to keep the student completely occupied with studies 
and with his reading programme. This means that examination is not the 
end of studies but only an instrument to teach and check how far the student 
has followed the course of studies. It is a tool to help the student to under¬ 
stand the subject. 
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"'■le Semester System 

D, S, YELIKAR 


EDUCATION DEFINED 

education DIFFERS from iiistrucLion which IS imparled in ii controlled 
environment. The educational process begins at the birth of an indivi¬ 
dual and ends with his life, may it be geneial education or scientific and or 
professional education. It is difficult to define education in a nut-shell. 
However, it can only be explained. 

‘■The Science and Art of Education is relatac conscience and un¬ 
conscience, psychological, sociological, scientific and philosophical en¬ 
vironmental process leading to the development of all aspects of indi¬ 
vidual’s personality so as to secure the best possible happiness through 
conservative and creative means." 

Education involves individualistic aspects as well as sociological aspccl^. 
No doubt, after independence, university education which had its start 
around 1857 in the modern sense of university education in the British 
Regime, has been expanding. 

Educational institutions have to serve the purpose of mass education 
and at the same time maintain the standards and also the man-power re¬ 
quirements of the society. Institutions should be the centres of learning 
and research, while exploring the best talent and nurturing it and making 
it available to the society. Zoologically, man is an animal and it is his 
intelligence and skill that differentiates him from other animals. The 
best accumulated by him is the culture which is his heritage. It is univer¬ 
sally acknowledged that the educational institutions particularly the col¬ 
leges and the universities should enjoy full academic freedom. Experi¬ 
mentation on the younger generation should be done with thoughtfulness 
and maximum care. In this context, it will be worthwhile to critically examine 
the merit! or demerits of the semester system. 



WHAT IS SEMESTER SYSTEM? 

The literal or dictionary meaning of semester is half year. The semes¬ 
ter system prevails in U.S.A. and other countries. The academic session 
there is called a semester. The academic year is divided into two or three 
sessions of four months’ duration each called semesters. Number of credit.s 
is the basis for the aWard of the degree. Courses are of 2 to 4 semesters 
each. The total work-load is of 20 periods per week. A two credit course 
involves two periods a week and a four-credit course 3 or 4 periods per week. 
For a four-semester course, the number of prescribed credits is 80 and for a 
6 semester course the number of credits is 120. 

THE NEED FOR SE.MESTER SYSTEM 

In U.S.A. as in India the college-going students arc within the age group 
of 15 and 18. Actually this is the time which decides the career of the stu¬ 
dent, The student cannot decide by himself his own choice of the subject(sj. 
Therefore, courses are diversified and the syllabi are framed by making 
self-contained units. There is a wide range of choice made available to 
the student. The courses are not one subject or discipline but many a time 
they are inter-disciplinars. The instruction is im,parted in different depart¬ 
ments depending upon hi.s choice of the course. In short, many things 
are provided to many people. A student is provided with open counselling 
and guidance by teacher. He or she is advised to choose the right type 
of combination and in case the student does not find interest, he is allowed 
to go over to another combination. Ultimately, by looking at the credit 
earned by him during the course of his studies the student's inclination is 
discovered and he or she is guided by his or her teacher in the choice of 
further studies. 

Another reason forintroducing the semester system in U.S.A. and other 
western countries i.s the need for high specialization. Industrialization 
and advancement of science and technology ha\e radically changed the wes¬ 
tern society. Anew quantum of studies is added to every discipline and the 
inter-disciplinary barriers are broken. Subjects like Biophy sics and Zoopsy¬ 
chology arc a few of the recent additions to the traditional disciplines. The 
semester system establishes a close relationship beiw'een the teacher and 
the taught. Less of lectures and more of assignments is the core of the 
semester system. In U.S.A. even the co-curricular and extra-curricular 
activities which are equally important for the development of personality 
of an individual have to go together and as such are included in the curri¬ 
cula. A student who specializes in debates is examined by the Department 
of Speech UCLA (Gokak Committee Report) seminars, tutorials, class¬ 
room discussions motivate the student and make him self-relient and critical 
ill his approach by making use of his psychological and intuitive faculties. 
The student there has to work for 25 to 30 hour-s per week under the guidance 
of the tutor or the head of the department. The topics of study and the 
list of reading material are given to him for self-study followed by discus¬ 
sions. In India, a student works for an average of 18 to 20 hours a week. 

the semester .SYSTEM IN INDIAN CONDITIONS 

The semester system appears very attractive and appealing to our 
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educators and the educationists. This system as introduced in some of the 
Indian universities is conditioned and as such a hybrid one. Of the 76 
Indian universities, so far about 20 universities have adopted the semester 
system in one form or the other. Ofthose universities which have adopted 
the semester system, three are worth mentioning viz., Aligarh Muslim 
University, Delhi University and Meerut University. A critical 
evaluation made by Prof. S. M. Ziauddin Alavi in ‘Educational India’ Vol. 
36 No. 9, March, 1970, deserves the attention of other Indian universities 
which contemplate the introduction of the semester system. Prof. Alavi 
has stated that the semester system in the Delhi and Meerut universities 
is in troubled waters and that an agitation by the students is a foot for its 
abolition. He has elaborately described the shortcomings and defects 
in the implementation of the system in his o\Vn university /. t>. Aligarh Mus¬ 
lim University. 

A revision of the curricula/syllabi to suit the instructional needs is a 
pre-requisite for introducing the semester system. A subject is divided 
into self contained topics or units. The courses are more or less inter-dis¬ 
ciplinary and the student has to go from one department to another for 
instructional purposes. Diversified combinations are given in the syllabi. 
However, a student’s choice is restricted to those disciplines or subjects in 
which facilities in respect of staff and other amenities exist. So. on paper, 
there is a wide range of choice but in fact the choice becomes restricted owing 
to limitations of finances and staff and other facilities. The semester system 
also comes in the way of a student's participation in co-curricular and extra¬ 
curricular activities which are equally important for the development of 
individual's personality. The student is occupied from morning to evening 
either in a lecture room or seminar or in the library. Late admissions in 
colleges curtail the period of the semester leaving consequentially little time 
for seminars and discussions in the concluding part of the semester. Break¬ 
ing the subject into units and half-units results in the student's understanding 
the subject on a piecemeal basis and not as a whole. It lengthen.^ the daily 
time-table to 5 or 6 periods. The semester is generally followed by a public 
examination. Preparation for such frequent examinations leases little 
time to the student for his own study. Frequent examinations of the type 
prevalent here, put financial burden on the students and the parents. The 
student is examined at the end of the semester for his piecemeal achieve¬ 
ment unless there is a comprehensive assessment of his achievements at the 
end of the course. 

The core of the semester system is to cause student to study intensively 
during the course of the semester period, to make him think and reficct 
over what he learns and to evaluate his work by having internal assess¬ 
ment by Way of allotting marks for his tutorials, home-work, term-work, 
seminars, orals etc. In some of the universities there was evaluation through 
class-tests which had to be given up after due experimentation. Extra¬ 
neous factors dominated the evaluation. The colleges hardly m.aintained 
any record for class-tests and the class-tests which should have been held 
periodically were not conducted as such, but marks were forwarded at the 
end of the year. There were complaints against biased marking. There 
were complaints also from the colleges of unhealthy competitions leading 
to high marking to boost up the performance of their own students and 
so on and so forth although only about 20% of the marks for the papers 
were usually set aside for the class-tests. Prof. Alavi has concluded in 
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his critical evaluation of the semester system in practice in his otvn 
university that “the semester system is hardly suited for Indian univer¬ 
sities.” Considering the problem from the financial point of view also, 
it will be admitted that in U.S. A. and other developed countries the expendi¬ 
ture on education is borne by the private agencies. Country like India 
illalfords to spend on the experimentation and that too on an experiment 
which has failed miserably in some of the Indian universities after serious 
trials. 

CONCLUDING REMARK.S 

With such experience about the working of semester system, it is diffi¬ 
cult to imaginehoW any new university in its infancy can afford to introduce 
and implement this system. Many Indian universities adopted the three 
year degree course, considering it an improvement over the earlier four 
year degree course. The concept behind this was to reduce the number 
of examinations and to have an integrated degree course. After its imple¬ 
mentation. the academicians came to the conclusion that it is not useful 
and workable as it was thought to be. The old four year degree Course 
had two examinations and the present three years degree course has 
four examinations including the Pre-university. Many who earlier enthu¬ 
siastically adopted the three year degree course and worked it. have, 
of late, come to realize that older universities like the Bombay Universitj' 
have proved to be wiser in not adopting the three year degree course. 
Similar .'hould not prove to be the fate of the semester system. Experi¬ 
ment as it is working now. Even in the case where experiment of regional 
language as medium of instruction has been tried in place of English, there 
is growing realisation among the section of students, in whose interest it 
was done that they should revert to old practice of learning through the 
medium of English. The latest example of this is of Tamil Nadu colleges 
where students went in agitation against Tamil medium which was introduced 
there a few years ago and revert to English as medium. The Government 
on referring the issue to an expert committee has decided to yield to this 
demand as reported lately. All this implies that any major departure in 
educational policies and sy.stems has to be planned well by considering 
all aspects and not merely on sentimental considerations or cheap popular 
slogans. 

It is unfortunate that our present educational system is becoming 
highly examination-oriented. Examinations, of course, cannot be 
di.spensed with. They are only a part of the whole system, in which impart¬ 
ing and learning processes are other parts. Examination and through it 
degree-hunting are the order of the day. The indicative signs of this arc 
the growing number of examination guides, coaching classes, private tui¬ 
tions etc. Coming now to the new stunt ifr., the semesier system, it is also 
going to be looked upon merely as another form of examination procedure, 
the all-pervading high objectives of education are going to be lost. The 
true semester system comprises of three aspects v/’., method of leaching, the 
process of learning and the evaluation procedure (popularly know'n as 
examination). If it is to be successful, it has to be worked in the true spirit 
of these aspects and in an environment that will promote the honest grovv’th 
of this spirit, with good syllabi and with serious-minded student community. 
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It is the modernisatian of the curricula and of the traditional method of 
teaching that will go a long way in raising the standard of education and in 
improving the quality of students. Obviously for this to happen, the teacher 
has to be matched to the dynamism of curriculum and has to inspire the 
student and the community at large by his scholarship and by his role as a 
counsel, friend and guide to them. Mere introduction of semester sysem 
in its aspect as examination procedure is not going to help. It will bet just 
like putting the cart before the horse in theattcmpt at reorientation of edu¬ 
cational policies and planning. 
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Semester System in Improving 
University Ucucation 

RAIS AHMtD 


Radical rliurm is mussars 

I NiviRSlTS LDLCA'iioN i.\ Ij'Uia ill iIk modem sense of the term slarled in 
ihe British period. The narrow ends for which the universities were at first 
established are clearlt discernible from the purpose of starting the univer- 
Mties, slated in 1857, One of the purposes Was "to ascertain by means of 
evaniinalions the proficiencj acquired by candidates" and the other was 
"lo proNide a test of eligibility for gosernment seriice". 

In ihi,s background, both the narrow spirit of our university education 
and the dominating role of the examinations are understandable, ft be¬ 
comes clear w'hy universiiy education was confined to a limited knowledge 
of a few subjecs in a small set of combinations useful for discharging the 
routine functions in an administrative office, in the army. or in maintaining 
agricultural and engineering services. 

Now. however, the position has changed in two respects. We are 
an independent country and as such possess a vast legal, constitutional 
and administrative apparatus. We are expanding our industrial base through 
a number of plans and projects and we have the related apparatus of national 
and international trade. We have a network of foreign service including 
cultural relations with a large number of countries. We have nearly two 
hundred centres of research and possess a correspondingly large number 
of educational institutions. We, therefore, require personnel for filling 
a vast variety of routine jobs, and more importantly we require personnel 
to fill jobs of a nature which never existed before; jobs which require hither- 
tofore unconceived combinations of learning. They demand men of ideas, 
men who can think and create, men who can meet situations which are not 
described in books. 

On the other hand, each discipline has been transformed in the last 



so years from a somewhat static to a very much dynamic situation. Know¬ 
ledge and creative eflort is growing into areas which often lie between estab¬ 
lished disciplines. The sciences are developing very rapidly. Engineering 
has to keep pace with the sciences. The social and political structure around 
us is changing rapidly and as a result of this a great deal of new thought 
has gone into the established disciplines in humanities and social sciences. 
It is to be noted that in response to the new demands made on us the orien¬ 
tation of the universities which was entirely educative, has now to a large 
extent become creative. The universities are not merely teaching institu¬ 
tions. They are active centres of research. 

The question arises, whether the old educational pattern can be modi¬ 
fied here and there to serve our new needs, or whether some radical changes 
are called for. It is obvious that only the future will tell if institutions run 
on the old pattern will serve the needs of the new society or if those who 
are prepared to adopt flexible new pattens will serve the future needs bet¬ 
ter. 

A pattern that seems to be very attractive for meeting the new demands 
on education, is the semester pattern or system. This system means many 
things to many people, but the system which I have in mind. 1 believe, will 
become increasingly popular since it is manifestly in consonance with re¬ 
quirement of the times. 

A PROPOSED NEW PATTERN 

In the semester system which 1 visualise, each deparlinciU of studies 
or board of studies would divide the subject matter in its sphere into a 
number of self-consistent topics or areas or units. The material in each 
unit should be such that it may be covered in 30 to 40 lectures, delivered 
over a period of about 18 weeks. Of course there could be half units and 
sometimes connected sequences of such units. We may call such self-con¬ 
sistent units as “semester courses”. For each cour.se there would be an 
examination at the end of the semester and during the course it would be 
desirable to have internal assessment of the performance of a student based 
on tests, tutorials or other assignments. 

Every student would be assigned to a teacher w'ho could advise him 
regarding the courses to be studied. Therefore, a student with the help of 
his adviser would be able to select a combination of semester courses given 
by various departments of studies for attending during the semester. The 
adviser will keep in view the particular inclination of a student including 
his performance in earlier semesters, the requirements of the main discipline 
on which the student ought to concentrate and also the schedule according 
to which the courses are being taught in a particular semester. There would 
be a minimum of restrictions on the combinations of courses which a 
student might wish to study. 

This would be an ideal system treating each student as an individual 
having specific requirements of study. This system would also make it 
possible for a prograqime of study to be constituted which may be inter¬ 
disciplinary in character and at the same time may be oriented towards a 
specific objective. 

Inter-disciplinary courses are already being studied in a way, but the 
choices available in the old system are rigid in two respects. Firstly, only 
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two or three disciplines can be combined leaving out a number of impor¬ 
tant components; secondly, each discipline has to be studied for at least 
two or three years by undergraduates. The semester system based on unitary 
courses would make the choices far more flexible, which is essential because 
any undergraduate studying a particular subject in depth requires courses 
which are given by a number of departments. This flexibility is essential 
because inter-disciplinary courses cannot be specified for all time and for 
all men. Disciplines develop interconnections with other disciplines in a 
dynamic sense. Again, the gifts and motivations of a particular student 
may require an inter-disciplinary composition which we may have traditional¬ 
ly considered as irrelevant or unnecessary. The system of choices described 
is flexible in another sense. Undergraduates in our universities are usually 
in the age group 15 to 18 and this is a period when the interests of the students 
are likely to shift from one subject to another, before they are established. 
Therefore, we must have a pattern of education in which it is possible to 
allow a student to change from one major area to another in the course of 
his studies. Of course, each institution would lay down certain rules for 
the choice of courses and for the combinations and their changes. But it 
may be emphasized that these rules must be minimal so that they give the 
maximum freedom to a student and his adviser. 

The masters courses in our universities are usually single department 
courses. A student studies either Physics or Chemistry or Biology etc. 
With the semester system the concept of inter-disciplinary courses could be 
carried to the postgraduate level. Tliis would enable students to study 
disciplines much more effectively and economically. A student of physics 
could study chemical thermodynamics in the department of chemistry or 
group theory in the department of mathematics. In that with existing 
facilities many new areas could be covered at the postgraduate level, areas 
in which we are not yet training people and in which there are wide opportu¬ 
nities. 

I, therefore believe that education can be made more satisfying to the 
individual and it can serve the needs of a developing society much better 
if we adopt the semester system. 

.SOMH ADVANTACrS OF THE SEME.STER SYSTEM 

A number of people ha\ e considered the semester system as a construc¬ 
tive innovation mainly because the impact of the annual examination in dis¬ 
torting the objectives of education is greatly reduced. There is an exami¬ 
nation at the end of each semester and, therefore, a student has a tendency 
to study more uniformly throughout the year. Furthermore, the reliabili¬ 
ty of the examination improves as a whole because a student is subjected to 
shorter but more numerous questions. In my view, this is an important 
advantage but relative to the question of meaningful education discussed 
above, this is a less important point. In fact having too many examinations 
results in waste of time both on examinations and on preparation leave. 
Hence in this respwet the semester system could be a disadvantage, unless 
the examinations themselves are reformed. 

As far as the examinations are concerned it is quite true that they have 
grossly undermined the entire objective of education. A student should 
be trained in thinking, in being self-reliant, and he should be encouraged 
to utilise both the logical and the intutive faculties. The examinations 
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on the other hand tend to rely on memory and on preparation of certain 
ex|Kcted questions. Thus no matter how well the educational process is 
designed, the examination which emphasises a different set of qualities, will 
always dominate the picture. 

The objectives of education can only be served if, in spite of every 
fault that is usually mentioned in this connection, assessment of a student’s 
work is left to the teacher concerned. This is also the accepted policy of 
various committees that have been concerned with this question. It has been 
recommended again and again that our institutions should move away from 
the “external” system of examination to an internal system of examination. 
There is no need to examine this point in detail but I believe that in the 
academic world people will readily accept it. The semester system which I 
have described above is very well suited to intimate contact between the 
teacher and the student. The adviser should not only be an adviser for aca¬ 
demic work but he should also be a counselor for the student on all personal 
and educational problems. The teacher who is entrusted with a course 
should make an assessment of the day to day performance of a student and 
the same teacher should examine the student in the same class-room at the 
end of the semester. 

One of the problems which has plagued our education system is the 
high rate of failures at all public examinations. A good part of the failure is 
due to the fact the various “papers” in each examination are tightly coupled 
together and failing in one often leads to failing in all. In the semester 
system it should be very easy to make a rule that if a student has successfully 
completed the study of a course as shown by his day to day record, although 
he may fail in the semester examination of that course, he should hot have 
to read the course again. Tn addition, if a student has passed in a course 
both in the so called sessional work and the examination, heshouldnol have 
to r^at the course simply because he has failed in other courses. Thus 
passing in semester courses would be on the basis of each individual course 
and a record would be maintained regarding the number of the courses a 
student has passed. When he has completed the required number of courses 
for a particular degree, the degree may be aw'arded to him. In this manner, 
a student would never fail in the semester system, but certainly different 
students will take different periods of time to complete their courses. This 
would save not only money and accommodation in educational institutions 
(which is otherwise clogged by failures) but it would- also give the student 
and his family relief from a great deal of emotional strain arising from the 
frustration of failure. 

A significant advantage of the semester system and its unit courses is 
the possibility of organizing courses during the summer vacations. Not 
only would failures get a chance to repeat courses but other students would 
also be able to take additional useful courses during the vacation. This 
would lead to a more effective utilization of a university’s facilities which 
normally stand idle during vacations. This advantage is of particular 
interest to our country since the pressures for university enrolment tan be 
partly met by spreading out and staggering semester studies. 

NEED FOJt EXAMINATION KEFORM 

Semester systems of different kinds are now becoming increasingly 
popular in India and at present there are more than 20 university institutions 
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who have adopted this system. At the Aligarh Muslim University we have 
adopted a semester system which is very closely similar to the one 1 have 
described above except that our examinations are still largely “external”. 
This is because the academic community is not so self-confident regarding 
assessment as perhaps it ought to be. This is also because there is fear that 
if a single university gives up external examinations, its degree may be 
denigrated. This again is a baseless fear because fully internal examinations 
are going on particularly at the institutes of technology which certainly 
have a high academic reputation in the country and abroad. My feeling is 
that traditions take long to wither away. But time is not far when we will 
be able to go over entirely to examinations being entrusted to teachers of 
the various classes. 

1 have not mentioned the various difficulties which one experiences 
with the semester system. In principle a more flexible system offering a 
larger variety of course combinations would require greater efficiency in the 
keeping of records and preparation of result sheets. Shorter working 
sessions or semesters require speedier collection and dissemination of infor¬ 
mation. Such speed and efficiency is sometimes lacking in our educational 
set up designed for a rather slow and rigid system. I am sure no system is 
free of faults and the most important fault of the semester system perhaps is 
that it examines a student on piecemeal achievement. Comprehensive 
examinations could be used to take care of this difficulty. 


IS 



Suggestions Concerning 
3xaniination Reform 

G, P. GUPTA 


SOME QUESTIONS 

While RESTRUCTURING THE examination system, the questions that call for 
attention are: 

(1) Why should a candidate be made to wait for his lest of proficiency 
for one long year? 

Can this waiting period be curtailed? 

(2) Why should a candidate be detained and branded as ‘failed’ each 
time he takes an examination, although he has had no luck and 
chance in one or two courses/papers? 

Can this waste of human material be avoided and frustration 
checked? 

(3) Why should a failed or detained candidate be made to wait for one 
full year in order to get promoted to the next higher class? 

Can this be changed? 

(4) And, why should a candidate be made to carry a load of his pre¬ 
sent course-contents for the whole year without any qualitative 
benefit? 

Can this load be reduced and quality be improved? 

OUR AIMS: STRUCTLTtAL CHANGES NECESSARY 

One thing is certain: no foreign system whether American or English 
can be implanted in India. We have to design and develop—or rather 
mould—our own system suiting our requirements, conditions, objectives, 
resources and the stuff. We need developing a system which must aim at: 

(a) Reducing the yearly quantitative (not qualitative) load on the stu¬ 
dent. 



( h) Reducing the gap between tests of proficiency and knowledge. 

(c) Extinguishing fear of detention and avoiding thereby human 
wastage in the name of yearly failures. 

(d) Removing fear complex among students against examinations, 
(i?) Changing the attitude of students in diverting them from using 

unfair means and dagger-policies in and out of examination halls. 

A NEW SYSTEM PROPOSED 

In the new system that I propose, instead of holding one examination 
at the end of one full year, as at present, let there be two full-fledged exami¬ 
nations during the year—the first examination held in November-December, 
and the second to be over by April-May. These may be called ‘Semester 
Examinations’. Part of the course-contents for existing annual examina¬ 
tion should be taught and tested during the first semester and the rest of the 
course-contents be taught and tested in the second semester. The material 
in each course-unit would be such that it may be covered in lectures over a 
period of 20 weeks. Of course, these could be half-units or connected se¬ 
quences of such units but as far as possible self-consistent and self-contained 
topics, areas or units. These may be called Unitary or ‘Semester Courses’. 

This will reduce w'aiting period to the students for the examinations and 
will also amount to reduction of quantitative (not qualitative) load for 
examinations. 

In this process of bi-yearly examinations, each course-unit will be devot¬ 
ed week-long of continuous and concentrated teaching and study (as 
against 3 days in a week for ten months in the present system) with the result 
that more intensive teaching and reading of course material will become possi¬ 
ble without ‘hang-over’ of the subject for one full year as at present. 

Thus the impact of the annual examination in distorting the objectives 
of education will be greatly reduced and there being an examination at the 
end of each semester, a student will be prone to study more uniformly 
throughout the year. This will encourage intensive study on the part of the 
student and intensive coaching by the teacher right from the beginning of 
the term resulting in little waste of time during the early days of the session 
as at present. The quantitative load for an examination will be reduced 
without lowering the quality of work and the student will feel free from the 
load of course after each half-year devoting himself, immediately after, on 
fresh studies for the next half-year. Innovations in the area of teaching tech¬ 
niques will become possible and modernisation and straightening of course- 
contents will become easy. 

In the proposed semester system, a candidate failing to reach the quali¬ 
fying level in any course/paper at an examination would not be branded as 
‘detained or failed’—on the other hand, he would be allowed to undergo 
instructions prescribed for the next semester and be required to clear the 
unfinished courses/papers of the previous half-year as ‘left-over’. This 
process of clearing the ‘left-over’ may be allowed to go on till the candidate 
reaches the end of final degree examination. He should not have to repeat 
the semester course simply because he has failed in some course-units. He 
would be admitted to the degree only when he has completed the require¬ 
ments of clearing all courses/papers prescribed for the degree. 

This will help in reducing the wastage of human material caused by 
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failures’ at each examination, will save money and accommodation in edu¬ 
cational institutions, otherwise filled in by failures, and will also save the stu¬ 
dent and his family from emotional strain arising from frustration of failures. 

The candidates will make it possible to take different periods of time to 
complete their courses and degree and will thus be enabled to plan their 
academic career over a period of time. All the graduates will not then flood 
the employment market at the same time and in the same month of the 
year causing thereby a famine of jobs. The candidates will have the facility 
and convenience of clearing the degree courses as and when they will feel 
free to do so. The steel-frame aspect of university examinations will be 
eliminated. 

Another advantage of the semester system will be to utilize the summer 
vacations when it would be possible to teach and test courses not only to 
the repeaters but also to freshmen deciding to offer additional'courses during 
the summer recess. This will lead to effective utilization of university re¬ 
sources remaining idle during the vacations and would also meet the pres¬ 
sures on university enrolment by spreading out semester courses and 
studies. 

Thus with two examinations of shorter gap, less work-load, with more 
compact and concentrated teaching, and with no fear of detention or failing, 
a candidate will have no reason to suffer from examination fever and fear- 
complex against examinations. And then probably, he will not be encoura¬ 
ged to use ‘dagger tactics’ in the examination halls. He will have the conso¬ 
lation and the facility of clearing the courses at each half-year without 
waiting longer for the annual examinations or repeating the courses as a 
‘repeater’ carrying with him an inferiority complex amidst his juniors. 
There will be more compact teaching with better output. Teaching methods 
and devices will change for the better, the teacher will have a compromise 
between teaching and talking. 

MERITS OF THE PROPOSAL 

1. Reduction of waiting period for tests of proficiency from one year 
to six months. 

2. Curtailment of work-load for each examination without reducing 
the total quantity of courses. 

3. Resolving fear complex among the students against examinations by 
reducing the gap between two examinations. 

4. Avoidance of wastage of human material through detention and 
failures, without lowering the standard. Candidates will meet the 
requirements of the degree on a dispersal basis. 

5. More intensive and compact teaching by devoting more time and 
introducing compact teaching practices. 

6. Supplementary examinations and re-examinations will be dispensed 
with resulting in economy and comfort to administration. 

7. Course contents and course material will be improved through 
compact teaching and concentrated instructions in the class-rooms. 

8. Awareness about the examination among the examinee-students and 
a sense of trust in the system. 


88 



CONCLUSION 


Summing up, our examination, system need be recast so as to fit in the 
present context of things economic, social, political and psychological. 
Claims are often made in favour of rationalising the syllabi or modifying the 
teaching techniques to resolve the present examination ills. Also, suggestions 
are advanced to improve the calibre of teachers and standard of books to 
rectify the examination malaise. But all these palliatives will be of little 
value unless examinations are made to be the testing instruments of know¬ 
ledge and are made an inseparable limb of the students’ reading schedule 
by assimilating them into over all teaching and reading programmes of 
colleges and universities. Marginal adjustments or even manipulations in 
syllabi, books, reading material and enhancement of grace marks each time 
will make nothing more than a patch-work, unless the system and the frame 
of examinations is improved and redesigned. The system must be accept¬ 
able and must aim at judging the over all performance and knowledge of 
examinees. It must be easy to operate, economic to adopt, clear to under¬ 
stand and follow and clean to create confidence among all concerned. 
The position of the teacher, the chief motivating force behind the system, 
has to be redefined to yield better results. Unless the system is redesigned 
to meet the situation, as it obtains today, examinations will continue to be a 
‘police action’—wherein examination halls will have to be guarded by the 
police force and the invigilator will have to act like a ‘police man'. The 
structural change proposed here above is only the first step in right direction— 
later will come other questions of tools and techniques. 
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.nternal and jxterna'. Assessment 

N, B. TARE 


The present system of assessment which prevails in most of our universities 
is by Way of annual and biennual external assessments at the Pre-university 
or degree courses. It is really high time that we seriously think of abolishing 
the external assessment system, partially at least, if not altogether. 

This does not mean that there is need to condemn the external assess¬ 
ment outright. The internal assessment should take its place gradually and 
partially but should not altogether supplant it. Conditions are not quite 
ripe in our country for such a total and radical change. The internal assess¬ 
ment will have to be adopted stage by stage as examination is an educative 
process and plays a great role in educating the students. External assess¬ 
ment should be supplemented by internal assessment at the Pre-university 
and degree courses in the science subjects to start with’, and if it works well, 
it should gradually be extended to the other faculties also. 

The internal assessment may be based on tutorial system at the Pre- 
university or first year degree courses, and at the B.Sc. or engineering or 
medical degree courses it should be based on semester system. The semes¬ 
ter university examination should be held at the end of each academic term 
in definite units of courses of studies. This will reduce the total burden of 
mental tension at the end of the year caused by one single final examination. 
There should be a mid-semester test or internal test conducted by the college 
for which internal credit should be given. The marks for internal assess¬ 
ment and the external assessment should be combined and final results pre¬ 
pared. Such semester examination system with slight modifications has been 
implemented in Delhi University, Aligarh Muslim University, Banaras 
Hindu University and Vishva Bharati University. The w.ightage of marks 
for the internal assessment both for theory and practicals varies from 20% 
to 50% as given in the “Report of the examination reforms in Central 
Universities 1969”. The semester system examinations have been also 



implemented in about nineteen um'versities as stated in the Annual Report 
of the University Grants Commission 1968-69. 

The “Report on examination reform 1962” brings to light the fact that 
the assessment of day to day and periodical work of tile student varies from 
one university to another. ‘Marl^ allotted to internal work in some of the 
subjects vary from 5 per cent to 100 per cent, the maximum of 100 per cent 
being the case in certain practical aspects of engineering courses’. It is like¬ 
ly that there would be some variation in the marks of internal assessment as 
compared with external assessment but this should not be of an extreme 
degree. It could be justified that the students could earn more marks for 
sessional work or for internal tests conducted by the college because a limit¬ 
ed portion with two or three topics in a subject for such internal test is 
completed in hardly a couple of months. The internal option is also given 
to some extent for these sessional works or internal tests and the students ob¬ 
viously get the advantage of answering questions of their choice. Memory is 
not much taxed as compared to the university examinations but there should 
not be a great disparity of marks in the internal assessment as compared with 
external assessment. There is no doubt that the internal assessment 
coupled with external assessment is a very good system by and large 
but the success of the scheme depends on the greater reliability and correct¬ 
ness in assessment. The system of internal assessment will have a deep 
impact on the study and learning habits of the students. Probably the over¬ 
estimation of the internal assessment may be due to the desire of the teacher 
to improve position of the student at final examination. While the marks 
obtained at the internal assessment in some colleges may be trustworthy 
but where there is an over-estimation in the internal test the marks may not 
be reliable and then the combined marks of the internal and external assess¬ 
ment become suspect. 

In the Shivaji University prior to the introduction of the semester sys¬ 
tem, a meeting of the principals of the science colleges was convened. A 
Working group was set up to suggest ways and means to implement the 
semster system and the academic council accepted the scheme with the re¬ 
organisation of the annual examination into semester and mid-semester 
examinations. The boards of studies were given the directives to revise the 
syllabi to suit the mid-semester examination to be conducted by the col¬ 
lege and semester examination to be conducted by the university at the end 
of each term. 

The semester system was first introduced in the faculty of engineering 
five years ago in the Shivaji University. Under this system in the engineering 
examination which has a four-year course, besides the written paper of 80 
marks each at university examination and a mid-semester test of 20 marks 
conducted by the college; 2S to 50 marks (in certain subjects 100 marks) 
have been assigned in many of the subjects for term work done in the 
college. Assessment of term work is based on the depth of understanding 
■of the principles involved and not merely formal correctness of the results. 
Passing in term work which includes laboratory practicals, drawing and 
workshop is a pre-reouisite for appearing at the semester examination. 
This system has compelled the students to work more assiduously. 

The suggested working of the semester system in the Engineering faculty 
encouraged the Shivaji University to extend it to other faculties as well. It 
has since been introduced at the B.Sc. and the postgraduate degree exami¬ 
nations in the science faculty. Here too a six monthly university examina- 
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tion is held and a mid-semester conducted by the college with certain per¬ 
centage of marks assigned to day-to-day practical work. A credit of 20% 
of marks is given to the mid-semester examination conducted by the college. 
Passing in the semester examination of the university is a condition for 
admission to the next semester course. In respect of practicals, 23 marks 
are assigned by the college to the assessment of day-to-day practical work 
and 73 marks are reserved for university semester examination in practicals 
at the end of the second semester and 50 marks are assigned to day-to-day 
practical work and 150 marks are kept for university examination in practi¬ 
cals in principal subject at the end of the fourth semester. In assessing 
day-to-day practical lessons the student's general merit as assessed on the 
basis of initiative and originality method of work, completion of Journal and 
regularity in attendance are taken into account. 

The semester system has been introduced to the postgraduate course 
in M.Sc. from this year wherein internal credit of 100 marks (60 for theory 
and 40 for practicals) is assigned for each semester and 300 marks are assigned 
(200 for theory and 100 for practicals) for university examination at the end 
of each semester. In respect of mathematics, 300 marks are assigned for 
university semester examination and 100 marks are assigned for internal 
test. 

The general view is that the scheme is delinitely beiiehlting the students. 
The classes are more regularly attended and students are putting in more 
serious and regular work. So far as the teaching is concerned, it has become 
necessary for the teachers and management to see that it is strictly done 
according to schedule. The system imposes an obligation on the teachers 
and the managements of the colleges to see that portion assigned for the 
semester is taught within the semester period as there is no scope for leaving 
a backlog of teaching work to be made up at the fag end of the session by 
extra lectures, etc. as is sometimes the case when there is only one final exa¬ 
mination at the end of one year course or two year course. 

Further, in the Shivaji University the system of tutorial work and the 
mid-term test examination by the colleges has been introduced at the Pre¬ 
degree and B.Sc. Part II & Part III and M.Sc. courses respectively. This 
supplements the regular university examination. 20% of the total marks in 
each subject in theory paper are assigned to the tutorial work which is evalu¬ 
ated by the teachers in the subject. The marks of the tutorial test and the 
mid-semester test are made known to the students concerned immediately 
after the evaluation is done. The tutorial exercises are then discussed with 
the students in small batches. This proves of great help to the student.s 
since it serves as a warning to those who lag behind and an encouragement 
to those who do well. The students get an opportunity in these tutorial 
batches to get their performance properly discussed by the teachers. The 
colleges have to keep records including tutorial note-books for some period 
after the results of the annual examination for inspection by the university 
authorities. The university has thus a means of ascertaining the standard 
of assessment adopted by the different colleges. 

It is observed that this system of assessing tutorial work of the Pre¬ 
degree level and the system of internal assessment combined with regular 
mid-semester and^ semester examinations at the B.Sc. level can provide 
the best solution under the circumstances to examination reforms. The 
successful implementation of these systems of assessment and examinations 
depends on honest and dedicated teachers. Sometimes glaring difference 
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has been noted between marks obtained in the internal tests or the tutorial 
work and those obtained at the mid-semester test and the university semester 
examinations. This variation in the performances of some students is a 
matter which needs serious consideration. It may not be difficult to devise 
checks to keep such variations at a reasonable level. 

The following suggestions would secure greater reliability and correct¬ 
ness in the marks of the internal assessments and the external assessments, 
till the pattern is stabilised. 

The marks for external assessment be scaled with internal assessment 
where there is a disparity of more than 15% of marks in semester and 
mid-semester examinations. 

If the difference in internal assessment and external assessment is very 
wide the answer books of such students should be called for scrutiny and re- 
evaluation by a panel of examiners from the members of the board of studies 
in the subject, appointed by the university authority. 

Award of prize, etc. should be on the marks of external assessment as 
long as the university is finding glaring differences between the marks of 
internal assessment and the external assessment in different institutions. 

Marks of the internal assessment and external assessment should be 
shown side by side in the marks certificates issued to the students by the 
university. 

There should be a separate head of passing with the standard of 35" g 
at the semester and mid-semester examinations. 

Internal credit of not more than 2G%-.marks be given for internal assess¬ 
ment at theory and 25% for practicals. We should later on think of increas¬ 
ing the percentage when the scheme stabilises. 

The university should check the reliability and validity of the marks 
obtained by the students at the internal and external examinations and 
should give a warning to a college, where there exists a great disparity of 
marks between internal and external assessments. 

We will have to review the position of this assessment system every two 
or three years. If these measures are implemented meaningfully and honestly, 
and sincere efforts are made by the dedicated teachers, we will be able to 
achieve fruitful results and to raise the standard of education. 
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InterncU vs 3xtern£ Assessment 

C S. BENNUR 


The Secondary Educaiion Commission (1952) and the Bhopal Seminar 
on Examination (1956) strongly recommended in favour of taking internal 
examination results of students into consideration for the determination of 
their ability in a subject.^ The Examination Reform Committee of the 
U.G.C. (1962) recommended that the experiment is worth trying.® 

The Education Commission (1964-65) also recommended to abolish set 
syllabuses and the external examinations based on them altogether and to 
replace them by a system of internal and continuous evaluation by the 
teachers themselves,® 

From the above recommendations it is quite clear that internal asscs.s- 
ment is accepted as a necessary adjunct and that external examinations be 
done away with in course of time. 

THE PROBLEM 

In this paper an attempt is made to see whether external examinations 
can be done away with and if so what conditions arc to be fulfilled before 
external examinations could be replaced by internal assessment in our uni¬ 
versities. 

1. Measurement of Achievement in Mathematics—Dr. A. 1C. Gayen—Report No. 1 
of the Research Project on Examination —sponsored by Ministry of Education. 
Government of India, New Delhi, IPtil, p. 167. 

2, Report on Examination Reform—University Granls Commission, Delhi, 1962, 
p.41. 

], Report of the Educaiion Commission (1964-66) Educaiion and National Develop¬ 
ment-Ministry of Education, Government of India, 1966, p. 290. 



SAMPLE STUDIES* 

The studies relate to a few random cases. They are by no means ex¬ 
haustive and hence the conclusions are purely tentative. 

(1) The B.Ed. Course : The system of internal assessment is a part of the 
total assessment of the B.Ed. students. In the practicals students are assess¬ 
ed continuously and at the end of the course internal marks are added to the 
marks obtained by students in the external practical examination. 

For theory there is no internal assessment as such but the principal 
could set apart a few marks for essays and tests. These marks are added 
to the internal marks. The following tables give the coefficient of correla¬ 
tion between internal and external marks in practicals and theory separately. 

TjtBlE No. 1 

Coefficient of correlation hetn een internal and external marks of 




B.Ed. 

students 




(Practicals) 


B.Ed. 

practicals 


Cocflicicnl of 
correlalian 

r 

Whether significanl 
or nol 

Number of 
subjecL.v 
n 

1967.68 


41 

Sjgniticam al 01 level 

75 

1968-69 


56 

Significanl al 01 level 

100 



T/toLE No. 2 



Coefficient of correlation between internal and external marks of 
II. Ld. students 
(Theory) 



Cocfficjcni of 

Wbcihcr .s^fnifcaiii 

Niinibu of 

B.Ed. 

corrclaiion 

or not 

subjects 

theory 

r 


n 

1967-68 

53 

Significant at 01 

63 


From Table No. 1 (Practical) it could be seen that the coefficients of 
correlation between internal and external marks in practicals are significant 
for both years and for different batches of students. They are significant 
at .01 level. 

Similarly, for the theory part the coefficient oF correlation between 
internal and external marks of students is .53 and is significant at .01 level. 

(2) Engineering Courses : In respect of engineering students marks of 
one paper are taken up for study. In the second year engineering course 20 
marks are reserved for internal assessment and 80 for external examination. 
Table No. 2 shows the coefficient of correlation between internal and exter¬ 
nal marks. 

‘The marks of ihc sample cases were kindlj made available bj- f he Coniroller of E*a- 
minalions, Karnalak Univcrsily, Dharwar. 
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Tabu No. 3 


Coeffideiii of correlelion betveen ioleiiial i/iiJ exiornal inwk-i 
(Second Year Engineering Mathematics Paper Ij 



Coefficient of 

Whether signitiennt 

Nuinher of 


correlation 

or nol 

subjects 


r 


n 

S.E. Engineering 
Mathematics Paper I 

•04 

Not .significant 

130 


It could be seen that there is no correlation betw een internal and external 
marks 


(3) Postgraduate Courses: There is internal assessment carrying 100 
marks in the postgraduate science courses (M.Sc.). Internal assessment 
is an integral part of the course. The marks arc assigned on the performance 
of students in the periodical tests. The internal and external marks are 
added. 

However, in the postgraduate courses like arts and social sciences 
M.A.) there is internal assessment but the marks are not taken into 
.-onsideration. 


I ABU No. 4 

Cocfficieui of ciiirclulion between iiiieiiit ouv e.\tiriiul ii uil-i 
[M.Sc. (Bolany) saidciiis] 

\\ hoihcr !.itniJ'L'iim Niiinbi;i of 
or nol SLihjL-cls 

n 

S'gn.’riaii'l iU Cl .” 

It could be seen from Table No. 4 that there is high correlation (. 11) 
between internal and external marks and the coefficient of correlation ii. 
significant, 

l Aiiii No. 5 

ith’ffieieul iij unreluliaii helwccii inwnal iwd e\Hii;ut 


fM.A./M.Sc. Malhcmalics -.ludcni!.; 


Coefficient of 

Whether signiljcnni 

Number of 

correlation 

or nol 

subjects 

r 


n 

M.A.''M.Sc. Mathematics 



students 1970 - 0 JS 

Not signiljcani 

30 


There is no correlation whalsoetcr. The marks are not taken into 
consideration. 


Coefficient of 
correlation 
r 

M.Sc, Botanj ly?0 77 
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TjkBLfc No. 6 


Coefficient of correlation between internal and external marks 
[M.A. (English) sliidcnt<>] 


Course of M.A. (Lngli.sli) 

CoeHicienL of 
rorrelalion 

r 

Wlielber significant 
or not 

Number of 
subjects 
n 

1970 

71 

Significant at 01 level 

26 


There is high correlation between internal and external marks. The 
correlation is also significant. The internal marks are not taken into 
consideration. 

DISCUSSION 


In B.Ed. and M.Sc. (Botany) and M.A. (English) courses there is high 
correlation between internal and external marks. Internal assessment 1ms 
been developed as an integral part of the teaching-learning process. Perio¬ 
dical tests are held by the stall' members. Students know well that their 
performance is taken into account. Under such circumstances the corre¬ 
lation is high and coefficient significant. 

In the case of M.A. (English), even though the marks are not taken into 
consideration, still, there is correlation between internal and external marks, 
while in the case of M.A./M.Sc. Mathematics even though it is compulsory 
there is no correlation. The Mathematics students seem to take the interna' 
tests indifferently. That is why there is negative correlation between inter¬ 
nal and external marks. O herwise there would have been positive correla- 
lion as in the case of M.A. English students. In the case of Engineering 
students, there is no uniformity of assessment. 

conclusion 

Therefore, wheroer internal assessment has been developed as an inte¬ 
gral part of the course and where students and staff take internal assessment 
seriously there is lugh correlation irrespective of whether such marks are 
taken into account or not. 

These studies point out that internal assessment if properly developed 
is bound to lead to a stage, when we can do away with external examina¬ 
tions. However, certain conditions need to be fulfilled before this could be 
done. 

1. Internal assessment should be developed as an integral part of the 
teaching-learning process in all colleges and postgraduate courses. 

2. Each university should watch the progress of correlation between 
internal and external marks for some years say 3-4 years. When 
the necessary atmosphere is created and when there is sufficient 
evidence to show such correlation, the university may replace 
external exaniinalions in its departments first. 
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3. Internal assessment should be made compulsory in all subjects in 
all affiliated colleges. The correlation between internal and exter¬ 
nal marks should be watched for 3-4 years. Steps as recommended 
by the Education Comniission should be taken. 

4. The UGC should establish an Examination Research Wing to 
watch and guide the activities of all universities in the examination 
reform. 

5. Necessary facilities like liberal staffing of the departments and col¬ 
leges orientation courses, discussions, seminars and workshops 
for stafi members in universities and affiliated colleges on improve¬ 
ment of examinations, syllabuses, text-books, methods of teaching 
etc., should be simultaneously offered. 

6. And, lastly a high sense of professional honour should be develop¬ 
ed among all persons concerned with higher education. 



Scjeine :'or Internal Assessment 

V. S, MISRA 


For all practical purposes we have now external assessment only, which 
is based on a student's performance at a particular moment of time on very 
inadequate sample of questions. Consequently, no generalisation about a 
student's competence can be made on the basis of external assessment. One 
way to improve the accuracy of assessment is to have internal assessment. 
This paper proposes a scheme for internal assessment in our universities. 
In making the proposal the author has heavily drawn upon the suggestions 
and research studies made in India. 

PURPOSE 

Internal assessment serves several purposes; It helps teachers and stu¬ 
dents to make the work-load even throughout the year. It gives them a 
periodical evidence to judge their achievements and failures. The teacher 
comes to know what topics he has taught successfully and what he has not. 
The student comes to know that he has learnt successfully and what he has 
not. It acts as a motivating force for the teachers and students to improve 
their efficiency. It helps the teachers to judge the relative merits of their 
students and plan class work accordingly. It enables the department to 
judge the effectiveness of its various programmes. It keeps the guardian 
informed of the progress and problems of his wards, so that he may render 
necessary help to them in time. In short, internal assessment helps all con¬ 
cerned with the education of a student to do their best to improve his level 
of achievement. 

OBJECTIVES TO BE ASSESSED 


It should measure students achievement in the objectives determined 
by the department. The objectives would not be only a list of topics to be 



taught, but also an outline of mental processes and behavioural activities 
desired to be developed by teaching the topics. For this purpose seminars of 
teachers, educationists and evaluation experts may be organised. 

Meanwhile we may hypothesise various abilities, skills, etc., which 
university teaching should develop. We may expect that when our students 
enter life they will work hard, take right decisions, do and guide research 
and will be persuading conversationalists and convincing speakers. We 
may hypothesise the development of these abilities as the major objectives 
of university education. For taking right decisions, one should have up-to- 
date knowledge. The acquisition of knowledge should, therefore, also be 
an objective of education. 

OBJECTIVES NOT TO BE ASSESSEO 

Certain educational objectives such as a student's personal qualities 
—sincerity, discipline, etc.—and the part played by him in extra-curricular 
activities should not be given weight in internal assessment. This does not 
mean that these objectives are not important. A department may give 
separate certificates showing achievements in these objecti\'es. But to make 
the total of internal and external assessments more reliable only those 
objectives should be measured in internal assessment which arc to be measur¬ 
ed in external assessment. 


VAJIIATION FJIOM ONE TO ANOTHEJl DtPAHTMCSr 

The objectives of teaching may not be identical for all the departments. 
Thus, it seems desirable that the departments should be allowed some 
lattitude in the system of inicrnal assessment. However, if some guidelines 
arc not fixed by the university, each department may have its own system of 
internal assessment. In such case, internal assessment system may differ 
widely from department to department which may lead to complications. 
All the teachers with whom the present w'riter had an informal diiicussion 
on the point favoured the idea that some broad guidelines should be given 
by the university within which each department should do internal assess¬ 
ment and this seems to be a sound approach. 

PKIVATE CANDIDATES 

The problem of private candidates arises in some arts departments 
only. Most of the private candidates are such people who do not have time 
or money to have university education as a regular student. They prepare at 
home and a vast majority of them fail in the examination. To improve the 
achievements of private candidates some universities have recently started 
correspondence courses. Thus, it seems desirable that universities may 
extend the benefit of internal assessment to private candidates also as dis¬ 
cussed later. This would help private candidates to improve, would reduce 
wastage in education and elimiiuite any chance of misunderstanding that 
private and regular candidates do not take the same examination. Private 
candidates should be required to appear for such assessment and bear the 
expenses. 
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MARKS OR GRADES 


It is easier Lu elassily students m u lew ^say, four or five; grades than 
awarding them marks on a continum ranging from 0 to 100. But award of 
marks in internal assessment seems desirable for the following reasons: 
(a) We are used to marking system. Thus, any change in the practice may 
introduce complications, (fi) Marks are better description than grades of 
the actual distribution of abilities, (c) Marking system will make the com¬ 
bination of internal and external assessments easy, as in external assessment 
marks, and not grades are awarded. Alongwith a student’s mark his rank 
should also be indicated, as a student's achievement can be properly judged 
only when both his mark and rank are known. 

methods of assessment 

(a) Assignments and Tutorials: Properly designed assignments and 
tutorials are of much educative value. They educate students to do hard 
work, make use of libraries, write good compositions and develop the art 
of conversation and speech. The U.G.C.'s Report on Examination Reform 
has recommended that “In order to make room for more tutorials, lectures 
may be cut down (it should be possible to reduce them by 50 per cent) and 
the teaching work divided between tutorials and lectures"’. But if assign¬ 
ments are not designed properly they may lose their educational value. To 
make the point clear: The assignment “What are the various theories of 
learning?" may at best measure knowledge, provided the students have 
written the answer on their own. Tf they ha\e simply copied the answer 
from books, it does not measure knowledge even. "To improve the assign¬ 
ment we may make a minor modification and ask the students to write '‘The 
influence of various theories of learning on the teaching-learning practices 
followed in the secondary .schools of Assam". .Assuming that it is a new 
question answer to which is neither available in any book nor has been 
laught in the class, we may expect that it will make students consult available 
books on Learning, comprehend the various theories of Learning, identify 
[he teaching-learning practices followed in our secondary schools, relate 
theories to practices and draw inferences. .Another purpose of assignments 
is to develop the art of good writing. Coherent writing is not a spontane¬ 
ous outflow of thoughts. It has to be learnt by practice: and assignments 
provide an opportunity to learn it. 

Assignment needs to be thoroughly commented upon by the teacher. 
It may even be returned for re-writing. Finally, it has to be discussed in 
tutorials or seminars. To provide every student of the group an opportu¬ 
nity to speak, the number of students in the tutorials or seminars may be 
limited to ten. The number of assignments may differ according to the 
nature of the assignments. As a rough guide ii may be suggested that 
assignments should keep students busy at home for at least six hours a day. 

The inclusion of assignments and tutorials in internal assessment will, 
no doubt, make the assessment more comprehensive. But the factors, as 
detailed below, may lower the reliability of assignments: 

First, assignments are written at home. When weight is given to them, 
some students who feel that they cannot get high marks by their own ability 
may be tempted to copy other's answers. In science department, where 
mostly problems and quizzes may be given in as,signments. it will be difficult 
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to identify the one who has solved the problem himself and the another 
who has not. Second, in some department, assignments and tutorials may 
not work out satisfactorily due to a large number of students. Third, the 
number of tutorials is less for the present and it is probable that some stu¬ 
dents may not get an opportunity to speak throughout the year. Fourth, 
assignment markings have often been found to have a halo-eifect, that is, 
while marking an assignment a teacher is often guided by the impression he 
has about the student rather than by the actual merit of the answer. This 
is on account of the weakness of the system and not of the teacher. 

It is, therefore, suggested that for the present no weight be given to 
tutorials and assignments. However, a record of students’ performances 
in assignments and tutorials be maintained. On the study of reliability and 
validity of these marks, the weights to be given to assignments and turorials 
may be determined. 

(b) Tests : We may use essay-type tests, short-answer-type tests, objec¬ 
tive tests and oral tests. To make the marking of essay-type tests reliable, 
it is desirable that every precaution to conceal the identity of the examinees 
is taken and each script is marked independently preferably by three teachers 
or at least by two teachers. When there is a large difference between the 
marks given to the same script by different teachers, the teachers may discuss 
with each other and reconcile the differences. This procedure will increase 
the reliability of marking, help teachers to improve setting questions, reduce 
subjectivity in marking and shield examiners from pressures or criticisms. 

Objective and short-answer-type tests have several advantages over 
essay-type tests. They cover much more area than that covered by 
essay-type tests. They can be scored in short time. Marking reliability 
is very high for short-answer-type tests and almost perfect for objective- 
type tests even when they are marked by only one teacher. They are more 
effective than essay-type tests in diagnosing weak and strong points of stu¬ 
dents, because they can test several aspects of learning in a .short time. In 
the U.S-A. objective tests are used with high proficiency up to the post¬ 
graduate level. There seems no reason why the same cannot be employed 
with advantage in India also. Every department may construct a pool 
of such tests. Oral tests have been found to be highly reliable and valid. 
Such tests provide an opportunity to students to speak out their under¬ 
standing, contradict opposing ideas and support Ikeir own views. They 
give teachers an opportunity to judge intensively and extensively a student’s 
achievement. Furthermore, they prepare students for future life where they 
may frequently be required to use this faculty. Research has shown that 
objective and oral tests are more valid than essay-type tests for predicting 
achievement even in essay-type tests. As such, we may use oral and objec¬ 
tive tests in internal assessment, even when we use only essay-type tests in 
external assessment. Oral tests may be conducted by a board of teachers, 
of which the subject teacher must Ik the member. A major limitation of 
the oral tests is that if they are not conducted properly, some shy students 
may not do their best. It is expected that there would be no difficulty in 
conducting oral tests. 

It is, therefore, suggested that at least two written and two oral tests 
evenly distributed over the academic year may be administered by each 
department. Private candidates may also be required to sit for these tests 
and bear the expenses involved. 
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(c) Dissertation : To make our students capable of doing and guiding 
research, it seems desirable that they should be given some practical training 
in research. A theoretical paper on Research Methodology and a practical 
work in the form of a research dissertation may probably offer a good oppor¬ 
tunity to learn the techniques of research. It will help students to learn 
how to select a problem, use library, collect and analyse data, draw inference 
and draft a research report. This will also give them insight into the intri¬ 
cacies of research. The dissertation may be written in a two-year period 
under the guidance of a teacher. This may be of 200 marks of which 100 
marks may be allotted for the written work and the remaining 100 marks for 
the viva-voce. The written work may be examined by two examiners one 
external and the other internal who may preferably be the guide. Likewise, 
in the viva-voce there should be one external and one internal examiner. 
The average of the marks awarded by the two examiners in the written work 
and viva-voce may be given to the student. The same practice may be 
followed for private candidates also. 

It is sometimes pointed out that a good research thesis requires at least 
two years full time work of a bright student. Since students do not have 
that much time to devote to research, their work may not be of the standard 
quality. The following is a suggestion to solve this problem; 

A research work of doctoral standard requires both quantity and quality. 
For the purpose of the proposed dissertation we may insist on quality only. 
A department may make a long term plan of the research problems to be 
undertaken by its students. It may accordingly plan for the collection of 
the data by one or more students. Then each problem may be divided into 
various sub-problems. A student may be required to select one sub-pro¬ 
blem (the same data may be analysed by several students, each finding solu¬ 
tion to a specific problem), so that a dissertation within its limited scope 
is a standard work. This scheme may create a congenial atmosphere for co¬ 
operative research. 

The students may be encouraged to write papers on the basis of their 
thesis. To provide incentive for further research and for information of 
other workers such papers may be got published in appropriate journals. 

(d) Experiments and practicals ; In certain departments some experi¬ 
ments are required to be done by students. The basic purpose of experi¬ 
ments is to educate students to test a hypothesis scientifically. In practice, ex¬ 
periments arc always prescribed and notes are available in the market which 
tell how to write the experiments in the examination or how to do them in 
practice. The notes give everything; problem, apparatus required, methods 
used, observation, calculation, results and conclusion. As they provide a 
student with digested thought, he has to do little thinking. This procedure 
trains the students to do the particular experiments, but does not neces¬ 
sarily educate them in the skill of framing hypotheses, designing experiments, 
and drawing inferences. 

In some foreign universities there is no practice of prescribing in 
advance the experiments to be done. While discussing a topic in the class 
certain problems arise. The students frame their hypotheses and design 
their experiments. In the beginning, sometimes the students find that the 
experiment does not answer the question they wanted it to answer. They 
wonder what went wrong, consult books and spent a restless night design¬ 
ing another experiment. The process continues till they get the right answer. 
Thus, the number and the problems of experiments may vary from year to 
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year, but by this process the students learn more in two or three experiments 
than what our students learn In a score of experiments. Sucli an approach 
to experiments may not seem feasible in our universities, but it is u possible 
direction to which we may move. 

For practicals, internal assessment is already there in almost all the 
universities. To give the student and the guardian an idea of how well 
the student is progressing, the assessments may be made on a terminal basi.s. 
We may have three or four such terms. 

WEIGHT FOB INTERNAL ASSESSMENT 

The determination of the weight depends upon the efficiency of internal 
assessment. However, in the beginning it seems desirable to make a humble 
start with 25 % marks for internal assessment in each theory paper. After 
the initial difficulties are overcome the weight may be progressively raised 
to 50%. For research dissertation 50% marks may he allotted to internal 
assessment in the manner already stated. 

RECORDS FOR INTERNAL ASSESSMENT 

Recording of internal assessment marks should be made as simple a.s 
possible. The head of the department may maintain the record of internal 
assessment. The subject teacher will enter periodically internal assessment 
marks. After the year-end a copy of the internal assessment record should 
be sent to the university. 

USE OF INTERNAL ASSESSMENT 

The student should be informed of his results. His strong and weak 
points are to be explained to him with special reference to his answer.s. 
Necessary suggestions for his further improvement may also be given to 
him. The progress of the student should be informed to the guardian 
also. 

It may be stated that the same report need not necessarily be sent to 
every one. For instance, the guardian should be informed of the progrcis 
and problem of the student and others of the capability of the student. 

COMBINING INTERNAL AND EXTERNAL ASSESSMENT .MARKS 

This seems to be the major problem.s confronting the agencies which 
introduced internal assessment. 

We do not add arithmetically 40 yards and 44 metres as 84. The two 
figures are converted to a common scale before they are added. The pro¬ 
cedure of converting examination marks to a common scale is technically 
called “scaling”. 

The need of scaling arises when the distribution of marks given in inter¬ 
nal assessment differs beyond a reasonable limit from that given in external 
assessment. If the diiference is within a reasonable limit there is no need of 
scaling. A method of scaling which takes into account the means and s.d. 
should be used to scale internal assessment marks to the distribution of ex¬ 
ternal assessment marks before the two are added. In the Gauhati Univer¬ 
sity we do this by drawing cumulative frequency graphs for (1) the external 
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assessment marks and (2) the internal assessment marks on the same graph 
sheet. The scaled internal assessment marks are then read by drawing ;i 
horizontal line across the two graphs. [Fig. 1 illustrates the point. In 
Fig. I, graph A represents cumulative frequencies on external assess¬ 
ment, graph B on internal assessment. For both the graphs the num¬ 
ber of students is the same, i.e., 50.] Suppose a student has got 30 marks in 
external assessment and 60 marks in internal assessment. We first scale 
internal assessment marks to external assessment marks distribution by 
drawing a horizontal line across the two graphs. The horizontal line which 
starts from 60 marks on graph B cuts graph A at 40 marks. So 40 marks 
are his scaled marks on internal assessment. His external assessment marks, 
as already stated, are 30; so his total marks are 40-1-30=70. Another 
method of scaling we could adopt is to ask the college to give ranks in inter¬ 
nal assessment. The ranks are then statistically scaled on the basis of the 
distribution of scores given to the group in external assessment. Another 
method could be the use of a link test. This may be used where both inter¬ 
nal and external assessments are based on the written performance of the 
.students. The link test could be of the objective-type. Since the link test 
is to determine the range of scores of the students, its reliability need not 
be very high. A 30-minute test may do. The internal as.sessment marks 
may then be scaled to the range suggested by the link test. 

RESEARCH TO IMPROVE EFFICIENCY OF INTERNAL ASSESS.MENT 

Various methods for internal assessment have already been suggested. 
The efficiency of these, separately and combined together and suggestions 
for improvements, if any, needs to be determined by research. 

In the end it may be stated that emphasis on internal assessment does 
not imply undermining the importance of external assessment. External 
assessments are as important as internal assessment and they also need fur¬ 
ther improvements. 

Before concluding this paper, we want to repeat that no appreciable 
reform in examinations is possible unless the teachers engaged in the exami¬ 
nation have some ideas of the theories and practices of educational measure¬ 
ment. It is, therefore, necessary that some programme for training of uni¬ 
versity teachers in Educational Measurement be undertaken by some central 
agencies. 
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Inteina. and Bxterna. Assessment 


VASANTHA RAMKUMAR 


iMbjiNAL ASSESSMENT HAS been put forward as a means to overcome the 
crippling influence of external examinations on the total process of education. 
It is intended in the present paper 1. to set out the main characteiistics of 
internal and external assessments, 2. to assess the possibility of combining 
the two types of assessment to arrive at a modified and more comprehen¬ 
sive pattern of evaluation for Indian universities and 3. to suggest the main 
steps to be taken to implement the comprehensive programme of 
evaluation. 

INTERNAL ASSESSMENT 

Internal assessment is based on a number of principles which differen¬ 
tiate it from external assessment and provide it with a set of characteristics, 

1. Evaluation by involved persons: Evaluation to be considered inter¬ 
nally has to be carried out by the teacher who has taught the group. 

2. Assessment of a wide range of objectives: This helps to overcome 
a serious limitation of external examinations, i.e., inclusion of a limited 
number of objectives. 

3. Assessment of the whole individual: The aim of internal assessment 
is to evaluate the child as a whole to which end, assessment of different aspects 
is helpful. Interpretation of isolated instances of behaviour is not an end in 
itself. 

4. A teaching and testing device: Internal assessment results serve as a 
diagnostic aid for finding out the learning process of the student. It enables 
a student to understand his strengths and weaknesses and thereby contributes 
to making leuoing more effective. It serves as an incentive to learning. 

5. Assessment of leaching: Internal assessment is an effective means 
of determining the effectiveness of instructional methods and materials. It 



enables the teacher to evaluate a prescribed course, a text book or a teaching 
method in the light of desired objectives. It helps the teacher to decide the 
degree of emphasis and direction of change needed in his teaching. 

6. Accommodation of indtvidual differences'. While external examina¬ 
tion ensures maintenance of standards, internal assessment provides for 
the accommodation of individual differences. Internal assessment aims 
at fostering the individual capacities of students and thereby enables 
them to attain their potential. 

7. Recognition of professional responsibility. Internal assessment 
places the responsibility for testing the teachers who were responsible for 
teaching. Its success requires of the teacher mastery of the methods, tech¬ 
niques and tools of evaluation. 

8. Periodic Assessment: Internal assessment has to be continuous 
and frequent. 

9. A large number of tools and techniques. To assess a wide variety of 
objectives there is the need for several types of tools and techniques. Seve¬ 
ral of the objectives which can be tested only in day to day situations have 
perforce to be tested by tools Which cannot always be chosen for their stan¬ 
dardisation. In addition to paper and pencil tests, it is also necessary to 
use questionnaires, checklists, rating scales, attitude scales, interest invento¬ 
ries, aptitude tests and personality measures. In brief internal assessment 
uses all available data for its purpose. 

10. Flexibility in standards: The purpose of internal assessment is not 
to level standards. The pass/fail dichotomy is not given the consideration. 
Also the attainment criterion is based on the type of activity and has to be 
interpreted in terms of the individual or group concerned. 

DIFFICULTIES IN THE IMPLEMENTATION OF AN EFFECTIVE 
PROGRAMME OF INTERNAL ASSESSMENT 

In spite of the many merits of internal assessment, there are practical 
difficulties which pose problems in implementation. 

1. The inherent characteristics of internal assessment—complexityand 
large number of objectives, comprehensiveness of learning situa¬ 
tions, frequency of assessment, involvement of a large number of 
people, use of a wide variety of testing devices and techniques 
need for expert knowledge and others. 

2. The subjective bias or‘halo-effect'in teachers evaluation. 

3. The lack of standardised tests appropriate for particular learning 
situations. 

4. The difficulty in being accepted by the users of the products of edu¬ 
cation. 

5. The inability, under the present circumstances to reduce the size of 
classes. 

6. The increase in the work schedule of teachers. 

7. The dominance of external examinations and its continuance since 
a long time. 

6. The slow acceptance of any measure of change by all concerned. 

9. The paucity of competent staff. 
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10. The period of training required and the linance required necessary 
for an adequate programme to provide an orientation totvard the 
new concept of evaluation. 

Internal assesStnetit in Indian Universities: The main features in the 
introduction of internal assessment in Indian universities are: 

1. To include internal assessment in the total evaluation procedure by 
fixing the weightage to be allotted. The usual practice is to allot 
twenty per cent for internal assessment. This proportion is very 
small when we consider the number of objectives covered by 
assessment. 

2. To employ the same methods of assessment for both internal and 
external assessment, thus defeating the very purpose of internal 
assessment. The same objectives would be repeatedly assessed and 
a large number would not be included in the a.sscssinenl. 

j. To depend on external assessment for the main purpose of evalua¬ 
tion, i.e., maintenance and levelling of standards, selection of stu¬ 
dents for higher levels of education and various occupations, for 
predicting future achievement and for linking education, eco¬ 
nomy and society. This approach takes away the very basis for the 
introduction of internal assessnrent and prevents the wider use of 
internal assessment. 

external assessment 

External assessment is adopted b> uniNcrsitics lor the purpose of: 

1. maintaining uniformity of.standards of evaluation proecdure>. 
over a large number of institutions. 

2. Maintaining academic standards w'hen a large number of insti¬ 
tutions are involved. 

The main characteristic of this ronnofcxaminaiion is that it is conduct¬ 
ed by an external agency and involves people who have not been directly 
involved in the process of teaching those who are being assessed. The fol¬ 
lowing characteristics arise out of the first: 

(a) Due to practical difiiculties external examination is usually con¬ 
fined to tests conducted at fixed interval.^, of time. The assess¬ 
ment is therefore not continuous. 

(/>) As a consequence the number of testing situations and the types 
of testing situations are limited in number. 

(f) Practical skills and abilities and the development possible in seve¬ 
ral areas cannot be assessed through external tests. 

{d) The number and type of tests that can be used in external assess¬ 
ment are very small in number. 

All these characteristics combine to result in a very serious limitation 
for external assessment—the number of objectives that are measured arc 
usually very few. The less tangible objectives arc often conveniently 
ignored. In addition to this limitation there are also several other defects, 
which are caused by the particular form of external examination adopted in 
our universities. The main defects are; 

1. Confinement of assessment to mainly one objective of education. 
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2. Prevention of raising of standards. 

3. Dependence on the essay type of test. 

4. Defects in the questions included. 

5. Inclusion of optional questions. 

6. Subjectivity of answers, lack of scoring economy and scorer un¬ 
reliability. 

7. Arbitrary allotment of marks for questions. 

8. Decision of pass minimum with no reference to difficulty level of 
question paper. 

9. Undesirable influence on teaching learning process. 

Practical examinations at all levels of university education and oral 
tests at the masters level and in professional courses have been introduced 
to overcome some of the defects of the written examination. 

The acceptance of the defects in the present system of external examina¬ 
tion conducted by our universities and the awareness of the importance of 
internal assessment have together focussed attention on the need for the 
introduction of a pattern of es aluation which is more comprehensive and 
includes both forms of as-icssment. not as alternate forms but as comple- 
luentary ones. 

CORRLLArjON HlJVM.l.N INrLRNAL AND Lxri:RNAL A.SSLSSMi;NTS 

Research has been conducted mainly at the secondary school lc\el to 
determine the relationship between the results of inernal and external assess¬ 
ments. The tindings are rather inconclusive due to many causes. (I) The 
rtilionalc olThe two types of tests arc different. t2) The purpose ofthe two 
types of tests tire difl'crcnt. f3) The tools and techniques employed are 
meant to coinplemeiil each other and not to validate one another. (4) The 
Nlandard-s of attainment and interpretation of achievement are not similar. 

It i.s Icit that a more fruitful direction of research would be (I) to corre¬ 
late the results of external and internal assessments only with the results 
arrived at by combining ihc two assessments. 12) to carry out prediction 
studies based on ihe results of a combination of methods. 

The findings ol'rcsearch and the experience of those countries that lia'c 
.icceptcd internal assessment on a wider scale base shown that (1) External 
or internal examinations by themselves cannot fulfil all the purposes of edu¬ 
cation. (2) External examination.s cannot and should not be dropped 
completely. (3) Internal assessment has a role to play which is quite 
different but in no Way less iniporlant than the external examinations. 
(4) A combination of internal and external assessment is the best 
method of evaluation. 

The attempt to implement a coinprehcnsive programme of evaluation 
including both internal and external assessment involves the solving of seve¬ 
ral problems. (1) The role of examinations in relation to objectives of 
education has to be clearly understood. (2) The proportion of w'eightage 
to be allotted to the two types of assessment will require a decision. A rigid 
iinposilioii of an arbitrary proportion cannot be accepted. The reqiiire- 
ntents of a particular course should decide this proporiion. (3) Internal 
assessment scores should not be totalled with external as.sessntent scores if 
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the purposes of both have to be served. The two scores which itieasure 
different things should be treated separately and interpreted in relation to 
specific needs. (4) The teaching within the classroom has to be oriented 
towards both types of assessment. (5) Assessment can no longer be confined 
to the classroom. (6) The professional competency of all the involved 
personnel with respect to evaluation has to be assured. (7) The users of 
the products of education have to be enlightened on the new concept of eva¬ 
luation. (8) The need for the use of a large number and types of techniques 
and tools of evaluation has to be met. 

The effectiveness of this process of evaluation however depends upon 
(1) the professional integrity and competence of the teahers involved, (2) 
continuous research into evaluation practices, (3) an effective follow-up pro¬ 
gramme of students and (4) an accredition system of institutions. 

Once the need for the modification of the present examination system 
to make it more comprehensive through the adoption of both internal and 
external assessment is accepted universities can take the following steps: 

1. The present system of external examination conducted by universities 
can be improved b y ; 

(fl) Raising the standard of the question paper. 

(h) Increasing the reliability and validity of the essay question. 

(c) Including objective and short answer items in addition to the 
essay. 

(d) Providing adequate training for paper setters so that the quality 
of the questions are raised. 

(e) Decreasing inter scorer unreliability through meetings and speci¬ 
fic directions. 

(/) Using computers for the scoring of objective tests to lessen the 
work ofexaminers. 

(g) Using standardised tests wherever possible. 

2. The present system of internal assessment has to be changed. 

(a) Internal assessment has to be made contin.uous over a long period 
of time. 

(b) The teachers involved have to possess the necessary knowledge and 
skills. 

(c) The necessary tools have to be provided. 

(d) The work schedules of the teachers and the teacher pupil ratio have 
to be modified. 

(e) The size of the classrooms has to be made small. 

(/) The Subjective element of internal assessment has to be accepted' 
and used for the improvement of evaluation. 

3. An evaluation cell can be established in every university with the 
following purposes; 

(a) Conduct external examinations. 
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(b) Facilitate the work of internal assessment. 

(c) Carry out research on all aspect of evaluation. 

The work of the evaluation cell Will include: 

(fl) The preparation, testing and compiling of test items. 

(h) Preparation of tools for internal assessment. 

(c) Provide training to college teachers in evaluation. 

{d) Carry on research studies—prediction and correlation. 

The teaching staff of the departments involved in the theory and practice 
of evaluation can be incharge of the evaluation cell. 
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Clewing o:' Varis and 
Answer Scripts 

V. S. MISRA 


As A STUDENTS merit IS judged by his marks, every step should be taken to 
check accuracy of marking. While checking of marks is a routine for objec¬ 
tive tests, it becomes difficult for e.ssay tests due to subjectivity of examiners. 
Thus the first step to ensure effective checking is to minimise the elements 
of subjectivity. 

SUGGESTIONS TO MINIMISE SUflJECTlVITl 

(i) Introduction of objective items : Most objectives measured b) tradi¬ 
tional tests can be better measured by objective items. This is the reason 
why the leading examination agencies in the U.S.'A. have switched over 
to objective tests, Unfortunately in India the potentials of objective tests 
have not been fully explored. A pioneer study done by the present author 
suggested that almost all the questions asked in Geography in Class X 
final examination of a Board of Secondary Education could be converted 
to objective items. The questions that may be made objective should be 
tested through objective items, For Technical reasons objective tests 
should be administered separately. Checking of marks for objective tests 
Would be accurate, speedy, and economical. 

(ii) Specificity in questions ■ The instructions should be so specific 
that there is no room for different interpretations as to what is and what is 
not to be looked for in the answer, and what credit would be given to differ¬ 
ent aspects of the answer. To illustrate the point, we reproduce a typical 
question asked in a university examination: “Write all that you know 

about Azealea Adair and.” Obviously the question does not 

specify what level of proficiency is expected from students and how the 
answers are to be marked. We give below a few formats in which the 
same question could be asked more precisely : 




FORMAT A. If the paper-setter wanted to measure oijy knowledge 
of the students about Azealea Adair, as the question seems to suggest, an 
objective question like the following could be most useful. 

Q. Who was Azealea Adair? 

1. Lawyer, 

2. Trader, 

3. Writer, 

4. Teacher, and 

5. Doctor. 

Similar questions could be asked to cover other salient points about Azalea 
Adair. 

FORMAT B. If the paper-seller aimed at measuring students' know- 
ledge expressed in their own words, short answer questions like the follow¬ 
ing could be better. 

Q. Wheredid Azealea Adairlive? 1 

(around ten words) 

How was Azealea Adair related to Caiser and Caswell? 

(around fifteen words) 1-1-1 

Why did the writer see Azealea Adair? 4 

(around ten words) 

FORMAT C. If We want to measure student's ability of interpretation 
of facts and organisation of ideas as expressed through written language, 
questions like the following could be better: 

Who was Azealea Adair? (around ten words) 1 

Is Azealea Adair a major or a minor character? 

(around ten words) I 

Why do you think so? (around fifty words) 2-F3 

(2 marks for facts and 3 marks for logical organisation of 
ideas). 

(lii) Provision of check lists : Examiners should be provided with a 
checklist. A difficulty in preparing the check list is that some points consi¬ 
dered important by one may not be considered so by another. It thus 
seems desirable to prepare the check list after consulting the paper-setter 
and all the examiners. If it is not possible, the paper-setter and the head 
examiner should independently prepare separate check lists. The final 
check list should include only those points which are common to both the 
checklists. For Format C something like the following could be used 
as the check list: 

The answer should include that Azalea Adair was a writer. She is 
a major character in the story. The reasons for considering her so 

should include 1. 2. Each of the two 

reasons is to be given one mark. Three marks are reserved for logical 
organisation of ideas. 

It is still better if the examiners are also provided with several answer 
scripts each representing a typical distinction, first division, second, third and 
fail levels. Harper in a personal communication has informed the present 
author that this is done in Hongkong by photo-olTsel reproduction of typical 
scripts selected by the head examiner. 
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(IV) Use of different signs to indicate different types of errors ■ In scor¬ 
ing objective tests, some people use specific signs to indicate different types 
of errors. This helps in analysing various types of errors conunitted by 
students. This method may be adopted for essay tests to facilitate cheking 
of marks- To illustrate, yte may ask examiners to cross spellings; strike out 
errors of ommission or commission in punctuations; underline a wrong 
construction of sentence; and add separately (e.g. -(-li) marks awarded 
for coherence of ideas. 

CHECKING OF MARKS 

(1) By the Head Examiner : In some Universities all the examiners work 
at one place under the close supervision of the head examiner. This practice 
has the advantage that communication between the head examiner and the 
examiners become prompt. This meeting should first review the check list 
and marking instructions, and make amendments in them if needed. After 
marking starts the head examiner should check a few scripts selected at ran¬ 
dom from the marked scripts of every examiner to ensure that the scripts 
are marked accurately. If there is a ground to believe that marking of an 
examiner is not accurate, all the already examined scripts of that examiner 
should he re-examined. 

In some universities the head examiner and the examiners work at 
different places. If the period allotted for examining the scripts is such that 
the head examiner may get a few examined scripts from every examiner and 
return them in time with his comments, he should do it. When it is not 
possible he should check a random selection of scripts after the scripts are 
returned from the examiners. If he feels that the scripts of a particular 
examiner are not accurately marked, all the scripts marked by that examiner 
should be re-exarained. 

(2) By the Scrutinizers : After the head examiner has made a sample 
checking of scripts, the scripts should be passed on to the scrutinizers, who 
should check all the scripts for the mechanical part of scoring. Such cases 
where an answer is left unmarked should be brought to the notice of the head 
examiner, who should examine himself the question left unexamined. Where 
an answer has been doubly marked or totals are incorrect, this can be 
corrected by the scrutinizers. 

PENALTY FOR FAULTY MARKING 

Examining like shooting is a skill. Faulty marking does not necessarily 
suggest lack of sincerity. It is therefore suggested that for faulty marking 
no further action than debarring the examiner from examinership fora speci¬ 
fied period should be taken. However, for careless marking a deterrent 
punishment may be desirable. 

RE-SCRUTINY OF RESULTS 

After the publication of results if a candidate wants his marks to be 
checked again, this may be done on the realization of the prescribed fee. 
This time the scripts should be scrutinized by some other scrutinizer. If 
the re-scrutiny reveals any discrepancy the results should be modified 
accordingly. 


114 



Scrutiny o: Answers 

V. N. PANDIT 


There IS nobody who is infallible and valuers are not an exception to this 
rule, Mistakes committed in some other fields can be corrected and the 
(liiinagc caused can be repaired; but when an answer-book is valued and the 
results arc declared on the basis of that valuation, an error in the marks 
allotted can be detected only if a candidate applies for re-totalling of his 
marks within a specific period. Once that short period is over, the result 
declared earlier can never be changed and it bears a stamp of finality. If an 
unfortunate student has suffered at the hands of a negligent examiner he 
remains a victim of that irreparable harm throughout his life and worse 
till the student knows not that he has suffered and the examiner knows 
not that he has caused the suffering. 

Immediately after taking over as the Vice-Chancellor of Nagpur Univer¬ 
sity in March 1966, Dr. V. B. Kolte decided to remove this defect in the 
system of declaration of results and established a small section in the Uni¬ 
versity administration which was called the Pre-tabulation Scrutiny of 
Answer-books. I have been associated with the University in this work 
till 1970. My observations given below are based on the work 1 did for 
the last five years. 

There were many types of mistakes committed by valuers-e.g.—(1) 
Marks given to a question inside did not tally with those written against 
that question on the cover page. (2) Total of marks for the answer-book was 
wrong. (3) Wrong posting of marks i.e., marks awarded to a question in¬ 
side were Written against a different question on the cover page. (4) Marks 
entered in words on the cover page were not the same as those in figures. 
(5) An answer or answers were left unvalued, (6) An excess answer was 
valued. (7) Even when nothing was written by the candidate, marks were 
allotted to blank pages. (8) Marks were awarded to stupid statements like 
“Sir, be kind to me and give me pass marks”. (9) Marks awarded to an 



answer were more than Ihe maximum allotted to it by the setter. (10) 
Even when the candidate answered all questions, marks given to some were 
not entered on the cover page. (II) While entering the marks in the /biK 
and counter foils they were written against wrong roll numbers. (12) Marks 
entered in foils and counter foils Were wrong. (13) Marks awarded to a 
candidate on the answer-book were not entered at all in foils and counter 
foils. (14) Roll numbers or enrolment numbers were not written or were 
wrongly written in foils and counterfoils. (15) Foil.' were prepred but coun¬ 
ter foils were not. (16) Alterations were done without signature. (17) 
Answer-books were not signed. 

There W'ere two categories of persons entrusted with this work: (/) 
checkers, and (ii) scrutiny officers. The checker’s job was to spot all mistakes 
committed by a valuer but they were not authorised to make any changes 
in the marks awarded by him. They were to note all these mistakes and 
bring those answer-books and documents to the scrutiny officer who was 
empowered to change the marks or cfl'ect any other corrections after he was 
thoroughly satisfied that it was necessary to do so. A script containing an 
unvalued answer was sent to the concerned valuer and he was requested 
to value it. The foils and counterfoils were sent to the tabulators only after 
all these mistakes were corrected to the .satisfaction of the Scrutiny Officer. 

Checkers were selected from amongst men and women lecturers and 
school teachers, and professors with considerable experience of compiling 
University results were appointed as scrutiny officers. But tbe most impor¬ 
tant criterion for the selection of the above mentioned persons was their 
honesty, integrity and zeal for doing the work with a conviction that they 
were doing something which would do justice to students. A scrutiny 
officer, possessing a little less integrity, would be a curse to the whole project 
as he could alter the original marks under his signature or point out the mi.s- 
takes of some valuers and hide those of others. The job had to be done 
without fear or favour as the \aluers included men and women of outstanding 
merit and occupied eminent positions in many unisersities. But it was 
carried out impartially and without the least regard for consequences. I 
had to be very careful, especially when an answer-book was to be sent to 
an examiner because an answer was left unvalued by him. There were vari¬ 
ous types of reactions. A few samples are given below. 

(/) I am very sorry for the mistake. Thank you for pointing it out. 
It has now been corrected. 

(li) 1 have been an examiner for the last so many years but this is the 
first time that such a mistake has been brought to my notice. I 
am grateful to the Nagpur University . 

(//'/) The answer deserved zero because it is utter trash, 1 did not think 
it necessary to write zero. 

(iv) 1 had already valued the answer before. The University is wrong 
in charging me that I left it unvalued. 

(v) The answer-book did not originally pertain the portion reported 
to have been left unvalued by me. IL must have been inserted 
there after 1 sent the packet to the University. It is a deliberate 
attempt to bring a bad name to valuers. 

Proportionate deductions were made from the remuneration bilks of the 
valuers and when they found that substantia) amount was sliced off their 
claims, they were naturally perturbed and, in seme cases, angry with what 
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(hey thought Was an unjustified accusation. Many came to the University 
office protesting vehemently that they could never have committed such 
mistakes, at any rate not in such large numbers, and the scrutiny officer 
must have committed a mistake himself. In such cases the record of their 
errors and the answer books valued by them were placed before them for 
their perusal. I am proud to say that till this day the University did not 
have to retract its decision even in one case. As we proceeded with the 
work in successive years, those who came protesting, went away acquiesc¬ 
ing. And since last year there is hardly anybody who protests. 

Since the University introduced this novel system, novel for it at any 
rate, for the first time in 1966, there was a great deal of curiosity and not 
a little scepticism generated in the minds of many persons. The Press also 
evinced great interest in it. 1 give below an excerpt from the “Current 
Topics" of the Times of India dated the 13th June 1966. 

l.AX r.XAMINEFS 

“The system of individual checking of answer papers introduced by 
Nagpur University and adopted successfully by some other universities has 
several advantages. It reduces the margin of probable error to the mini¬ 
mum, helps to bring to light lapses on the part of examiners, and guarantees 
Lliat a paper is assessed in its totality. 

In Nagpur, in 250,000 answer papers as many as 3,500 errors were 
detected. Some of these errors were mistakes in totalling which is under¬ 
standable, if also indefensible. What is astonishing is that as many as 200 
answers were not assessed at all. Apparently, in one case, out of 10 ques¬ 
tions answered, only six were assessed. Such laxity by e.xaminers is inexcus¬ 
able if only because their carelessness can seriously afl'ect a student's career. 
If individual checking makes examiners more vigilant and conscientious that 
alone would indeed be a great gain." 

Answer books of technical examinations posed peculiar problems. 
They have two parts of a question paper, each, of which had to be answered 
in a separate answer book. Many students wrote the answers for both parts 
in one answer-book, intermixed the answers or wrote them in wrong answer- 
books. These had to be sent to the proper v aluers, as the examiners to whom 
these answer books were sent initially, rightly left some answers unvalued, 
if they were to be seen by somebody else. What would have been the fate 
of ihc.se students in the absence of this scrutiny? 

The ratio of unvalued answers in 1967 was 1 in 1295 answer books, in 
1968, 1 in 1071, in 1969, 1 in 969 and in 1970. I in 945. This means that the 
tendency to leave answers unvalued is on the increase as is the case with 
errors of other types. 

During the last five years the University has trained nearly 2C0 reliable 
checkers and 7 scrutiny offi.:ers who could be called upon to do this work 
any time. In 1970 the maximum number of checkers and scrutiny officers 
at a time was 64 and 6 respectively. In previous years also, in the peak 
period, their number used to be more or less the same. 

One checker turned over nearly 300-350 answer-books a day between 
11 A. M. to 5 P.M. The scrutiny officer and other staff stayed on up to 
6.30 P.M. to wind up the day’s Work- The limit for each checker was 
.‘<000 answer-book.s. The rate of payment was Rs. 35/- for 1000 answer- 
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books. The scrutiny officer was paid @ Rs. 15/- per day and the Chief 
Scrutiny Officer @ Rs. 20/- per day. The University incurs an expenditure 
of about Rs. 19,230 '00 per year for this scrutiny. 

It would be interesting to see the amount of money deducted from the 
examiners’ bills on account of their mistakes. If 1970 i.s taken as a 
representative year, the figures are: 

2,800 major errors which alteredthe totals—punishable 
@ Rs. 3/- per error Rs. 8,400.00 

2,616 minor errors which did not affect the totals— 

punishable @ Rs. 1/- Rs. 2,616.00 

(Total of minor errors was 4633 but the Vice-Chancellor ruled that2017 
errors of wrong posting need not be -penalised though they would be regard¬ 
ed as errors for other purposes c.g. debarring an examiner frombeing given 
further valuation.) 

419 Unvalued answers—penalty Rs. 10 - per answer 

Rs. 4,190 00 
Total Rs. 15,206 00 

It is not my intention to show that the amount spent on the scrutiny is 
partially or .substantially recovered through the amount collected as a result 
of penalties levied. On the contrary the Univesity would be very happy if 
no errors are committed and consequentially no part of expenditure is 
recovered. Indeed, the Vice-Chancellor is anxiously awaiting the day on 
which, as a result of this report, the valuers do their duty of valuing answer- 
books so well as to render their scrutiny superfluous. But till that stage is 
reached it has to be an essential part of the examination system. 

It is likely that some may try to minimise the gravity of the situation 
by Saying that in 1970 the proportion of errors, major as we called them, 
comes to only 1 in 141 answer-books or by arguing that only 419 an.swers 
were left unvalued in 3,96,071 scripts. But this is a wrong approach. Human 
life and the career of a young boy are not mere economic commodities whose 
waste is pardonable as thar of some material in an economic enterprise. It 
is too precious to be Wasted and hence must be treated with the utmost care. 
The trust that the students place in the University must be fully ju.stified and 
to ensure that no injustice is done even to a single student, neither an\ 
labour, nor any expenditure is too much. 

The benefits conferred on students by this scrutiny are too obvious to 
need emphasis or repetition. What is needed is a little bit of introspection 
on the part of valuers. Why do they commit so many mistakes that could 
be avoided by themif they were careful? Do they not realise that the future 
of young and hopeful boys and girls lies in their hands? The University 
has ruled that if an examiner commits 4 or more mistakes, not only should 
the usual penalty be levied against them but he should be debarred from being 
a valuer at the next examination. In some cases he is not given valuation 
for a number of years if he commits an inexcusably large number of mis¬ 
takes. This is a big penalty for anybody. And yet the proportion of mis¬ 
takes is rising every year. Have the professors grown impervious to -this 
punishment and loss of face? Probably they think, in a mood of philoso- 
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phical resignation, that things in general and human nature in particular 
cannot be altered, as express^ in a Chinese proverb: 

“The legs of a table are short, 
we cannot make them long. 

The legs of a stork are long, 
we cannot make them short. 

So why worry?” 
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Practical 3xamination in 
Science Subjects 

R, K. MAPARA 


MODERNISATION AND REORIENTATION OF SYLLABI 

IT HAS BEEN observed that during daily practicals, students perform experi¬ 
ments mechanically. The experiment? prescribed at present in different 
science subjects bear little relation to modern scientific techniques. In order 
to impart a fresh out-look to techniques of teaching and learning practicals 
in science subjects, students should be induced to build up their own appara¬ 
tus and to improvise their own methods to develop greater experimental 
skill. 

In view of recent developments in scientific techniques, since 1956, 
Sardar Patel University (Anand) and since 1968, the other three Universities 
of Gujarat have commenced progressive modernisation and reorientation 
of the syllabi in theory and practicals nf various science subjects. 

EVALUATION 

In practicals, students' performance should be evaluated by (i) the 
continual assessment during the course of a year, (ii) periodical tests and 
(iii) final university examination. Proportional weightage should be given 
to the continual assessment, periodical tests and final practical examin- 
tion. 

It has been observed that the final results in practicals are considerably 
affected by the varied evaluation at the university examination. 

UNRELIABILITY OF FINAL ASskSSMPKT 

Scrutiny of the results of the last some years of Gujarat University 
and South Gujarat University has revealed that a number of students, who 



could not secure 60 % marks in the written examinations stood in first class 
because they got lots of marks in practicals. Extreme cases have also been 
noted in which candidates, failing in the written examination, secured more 
than 60 % marks in practicals. Thus the present system of assessment in 
practical examination has not been found to be an accurate measure of the 
intelligence and experimental skill of a student. Reasons for such unreliable 
evaluation are as follows : 

(1) As the number of students appearing at an undergraduate exami¬ 
nation is very large, different groups of examiners conduct prac¬ 
tical examinations at different centres. So personal factors have 
a considerable influence on the assessment in practical exami- 
tion. 

(2) Disparity in the nature of various experiments given to different 
students of the same batch or different batches. 

f3) The present stereotyped nature of syllabi in Chemistry practicals 
and practical exercises set at the final university examinations. 
Experiments, which develop creative ability and experimental 
technique of students are hardly set at the university examina¬ 
tion ut the undergraduate level. 

(4) In Physics, Botany and Zoology practical examination, marks 
are assi gned to the written part and the non-written part. Assess¬ 
ment of the non-written part depends upon the sincerity and vaga¬ 
ries of an examiner. It also deptends upon the number of students 
to be examined by an examiner in a day. 

{5) Detailed scheme of marking does not seem to be followed sincerely 
and rigidly by some examiners. 

M'GGESTIONS FOJl IMPROVEMENT 

The above-mentioned defects in the assessment of practical examination 
can be rectified by taking the following steps : 

fl) The Board of Studies in each science subject should define the 
objectives of performing various experiments. 

(2) The syllabi in practicals should be framed, keeping these objecti\'es 
in view. 

f3) The Board should unambiguously set up a detailed scheme of 
assessment for each experiment of the syllabus. 

(4) The scheme of assessment should be in conformity with the objec¬ 
tives to be tested. 

(.^j Whenever there is a change in the syllabus, work-shops should 
be organised to discuss details regarding the internal as well as 
external assessments of all the experiments prescribed in the new 
syllabus. 

(ti) A meeting of all the examiners at the practical examination should 
be arranged by the head-examiner to discuss fully the scheme 
of marking for the written and the non-written parts of all the 
practical exercises to be set at an examination. 
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Tractica'. Zxaminations and 
Viva Voce 

K.V. RAMANAN 


INTRODUCTION 

‘Nothing IS MOR3 revealing of ilic purpose uiidciiyiiig a course of study 
than the nature of the examinations given at its close. Nothing is more 
effective in telling the student what we want him to do than the method we 
take of finding out whether or not and how well he has done it.’ 

The above statement of the objective of examinations has not so far 
been truly applicable to the type of practical and viva-voce examinations 
held in colleges. Some of the important factor.s which need to he considered 
in judging the quality of a test are; 

1. Relevance, 

2. Balance, 

3. Efficiency, 

4. Objectivity. 

5. Specificity, 

6. Difficulty, 

7. Discrimination, 

8. Reliability. 

9. Fairness, 

10. Speediness. 

The current modes of laboratory and viva-voce examinations are in¬ 
efficient and have failed to serve the real purpose. Since inefficient examining 
cannot contribute to good training of the student, the only course an exami¬ 
ning body can properly take is to strive continually to improve its 
examinations so that they give the maximum support to good training. 



CUHilENT MODES OF PRACTICAL AND VIVA-VOCE EXAMINATIONS 

Owing to the large number of students to be examined in a limited 
time peiiod, most of the laboratory examinations are conducted in a manner 
which does not really test the experimental skill acquired by the candidate. 
The existing modes of laboratory examinations can be broadly categorised 
as follows : 

CATEGORY I 

About 10 to 15 students are examined in each batch for laboratory 
examination for a definite time duration ranging from two to three hours. 
The examination board consisting of one external and one internal examiner 
sets a fixed number of laboratory test questions. These questions are re¬ 
peated for each batch, with minor variations of data whenever feasible. 

During the time the students are busy with their experimental work, 
the examiners go around for examining each candidate orally. A few dis¬ 
connected questions on several topics are asked of each candidate without 
giving adequate time for the student to think and answer. The assessment 
in viva-voce is usually based on the number of correct answers, given by the 
candidate. 

The overall performance is judged by summing the performances of the 
candidate in (a) laboratory report, (b) final practical examination, and (c) 
viva-voce, 

CATEGORY 2 

In some practical examinations, the lack of adequate laboratory equip¬ 
ment has led to the following practice : 

The candidates are asked to write down individually detailed experi¬ 
mental set up, experimental procedure and method of calculation from 
observations. After the approval of the above by the examiners the candi¬ 
dates are asked to do the experiment in groups viz. 2 or 3 students are 
asked to do the same experiment. They are then asked to calculate the 
required data from the same set of common observations. 

CATEGORY 3 

The lack of adequate laboratory facilities has also led to a third inte¬ 
resting practice wherein the candidate is not required to carry out any prac- 
ticals. The board of examiners assesses his laboratory reports and the viva- 
voce is conducted by the same board. The assessment in this case is based 
on the candidate’s performance in his sessionals and viva-voce. 

CRITICAL STUDY OF THE CURRENT PRACTICE 

Let us critically examine the effectiveness of the current system of 
practical examinations. 

If a test is to be relevant, the type of questions should be such that it 
will measure the desired achievement. A laboratory course, should train 
a student in experimental skill and the methodology, and inculcate in him 
an awareness of error magnitudes and limitations of the experimental set 
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up and apparatus used. If a laboratory test is to serve a.s an achieve¬ 
ment test, the present practice of asking the candidates to repeat same ex¬ 
periments and same set of observations as obtained by him earlier in the 
course should be discarded. 

A test should also be balanred so that each aspect of achievement of 
the student is given a proper weightage. The present system is highly 
unbalanced as too much weightage is given to the laboratory reports in 
the assessment. In mass education, the reports tend to the verbatim re¬ 
productions of a few master reports, and in cases of laboratory courses 
where new innovative changes in experiments are not carried out, therepmrts 
are copied verbatim by several generations. Undue emphasis on laboratory 
report writing in stereotyped form lias led to a situation wh^re the student 
is tempted to spend an undue proportion of his study hours in mechanically 
Writing laboratory reports running into pages. 

If a large group is to be tested in \iva-voce oral repetition of the same re\\ 
basic questions to each candidate by the examiners is a highly inefficient 
way of conducting a test. Instead, a common written quizz is more eflicient 
for tilts purpose. This will also ensure objectivity and specificity of the 
questions. 

A test is considered to be appropriate m difficulty if the mean score 
on it is about midway between the maximum possible score and the expected 
chance score. In the present day laboratory examinations, the score docs 
not cover a wide range—for example the range of marks is usually betwccti 
50% to 90%—sometimes even 60 to 90^-’i,. This is due to the fact that ses¬ 
sional marks for the year are mostly awarded on the basis of the written 
laboratory reports. Not much distinction can be brought out between ex¬ 
cellent and poor students in such an as.sessment and hence the range of marks 
is narrow on the 100 point scale. If the test is to be elfectivc and reliable, 
it should be made more difficult. Only then there will be discrimination 
between good and poor students. 

A test is said to be fair to the extent that it actually demands of student-- 
the command of knowledge that the course was intended to develop. Hence 
a proper emphasis on examining the practical skill acquired is necessary. 

While speed is important in repetitive and clerical type operation, it i.v 
much less important in critical or creative thinking or in decision making. 
The fact that good students tend to be quicker than poor students is not in 
itself a sufficient reason for penalising the occasional good but slow student. 
The student’s score should depend more on what he can do than on how fast 
he can do it. This criteria is very valid for a laboratory examination or viva- 
voce. Hence the present mode of blindly asking a student to clear out of the 
laboratory at the end of a specified period of time has to be modified. Also 
the tendency to assume complete ignorance on the part of a student who 
is unable to give sharp answers readily for the disconnected questions which 
the examiner shoots off at random and the consequential practice of award¬ 
ing zero credit in viva-voce for such a student should be given up. 

To summarise, the validity of the practical examination and viva-voce 
as conducted today is questionable as it fails to measure what its title suggests 
that it measures. 
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SUGGESTIONS FOA IMPROVEMENT 

The following suggestions are worth serious consideration if the tests 
in laboratory courses are to be valid and reliable : 

1. There should be regular and continuous assessment of the progress 
of the student in the laboratory courses. This can be done eifectively if the 
instructor goes around and watches the performance of the experiments by 
the students. The instructor should also put a few relevant queries to the 
student while he is carrying out the experiment. Viva-voce for a few min¬ 
utes should become a normal feature of each laboratory session. 

2. There should be drastic modification in the mode of presentation 
of laboratory reports. Unnecessary repetition of text-book matter, des¬ 
cription of the procedure and theory should be eliminated. Prepared 
report-forms can be handed over to the students before the beginning of each 
cycle of experiments. The laboratory reports containing mainly recording 
of the observations, calculations, graphs and discussion should be valued on 
the same day as they are turned in, so that the student can be informed 
in person the defects in his report. This practice will avoid the piling up of 
lafmratory reports which are valued mechanically almost at the end of the 
year without any relevance or objectivity and will hence ensure a more balan¬ 
ced valuation of the reports. 

3. There should be periodic vsnlten quizzes based on the experiments 
carried out by the students. This will minimise errors due to subjective 
assessment of the candidates in a viva-voce. 

In a viva-voce, there is the possibility of the same set of questions being 
put to students of diiferent batches. This leads to an unfair assessment as 
llie candidates examined in batches subsequent to the first one have an ad- 
\antage. A common written quiz avoids this difficulty. 

4. The final laboratory examination should be conducted in such a 
way that each student will be given an individual opportunity to show his 
experimental skill. The questions set for the practical examination should 
not be mere repetition of the experiments conducted in the course. They 
should be set such that they test the skill and the understanding of the princi¬ 
ples of the measurement and the experiment. The experimental question 
need not be a long one, but it should be of such a nature as to test the achie¬ 
vement of the student in the laboratory course. There can be a compre¬ 
hensive written quiz for all the students. One should try to avoid dupli¬ 
cation in the experiments set up for the different batches, though this may 
involve more time in the preparation of questions. Innovative changes in 
the practical questions are possible without requiring entirely different ex¬ 
perimental set up. 

5. 'I'he viva-voce should be conducted after the student finishes his ob¬ 
servations so that he is in proper mental state for creative thinking. The viva- 
voce can be allowed to spill over beyond the set time-limit for taking the ob¬ 
servations. If the student is unable to answer any question, leading ques¬ 
tions should be asked to test his thinking power and his basic knowledge of 
the "Subject. Random questions lead to greater nervousness on the part of 
the candidate and a fair assessment is not possible. Hence the viva-voce 
should be conducted in such a manner that it will try to probe what he knows 
rather than what he doesn’t. 
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6. There should be a proper weightage for each compooent of the 
practical examination. A suggested weightage is given below : 

Continuous assessment based on students’ initiative, 

.skills, reports and quizzes 60 per cent 

Final laboratory examination : 

(i) Methodology 20 per cent 

(ij) Results 10 per cent 

(rii) Viva-voce and quiz 10 per cent 

CONCLUSION 

As the present mode of assessment of laboratory courses suffers from a 
series of limitations affecting the validity and relevance of the laboratory 
examination a more broad-based and objective type of assessment has to be 
introduced without delay. 

This can be achieved without much difficulty even within the existing 
framework of internal-cum-e.xternal assessment. 
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Sca'ing anc Graces 

A.E.T. BARRO\N' 


IIILSA.NCIH^ 01 KAW MARKS 

InE MYTH OF llic oiiiiiisL'iciKc of tile numerical marks awarded by exami¬ 
ners is nuriurcd in India and this sanctity accorded to raw marks is one of 
ihc main hurdles in the reform of the examination system. 

All illustration of this is quoted from the" ‘‘Statesman" of 26 Septem¬ 
ber 1970, 


•'THE ONE ON TOP" 


“The— • • ■ Hoard of Secondary Education has upgraded a 
successful student, who stood second in the final examination, to first posi- 
iion, reports PTl, 

The Board amended the original 50-name merit list of the March 1970 

examination, declaring- of-School at- 

to ha\c secured the first position. 

The amendment followed detection of an error of only one mark, on 
a request for verification by —. in the total secured by him in 

Sanskrit. This increased his percentage from 87.13 to 87,25 — 0.1 more 

ihan that of— -of— —. who had topped the original 

merit list." 

0.11 “o more than the next candidate-incredible! N'ei. this form of 
absolute worship of marks of examiners in India is 'absolute' 

The above quotation is not meant to be a criticism of any particular 
examining board, but a criticism of the present system. 

(llARACTmiSTICS OF A GOOD EXAMINATION : JILLIABILITV AND VaLIUHV 


Studies of the reliability of traditional examinations have been con- 





ducted from time to time, and the earliest enquiries, those of Valentine 
(The Reliability of Examinations —University of London Press, 1932) and 
of Hartog and Rhodes (^An Examination of Examinations, 1936) brought 
into prominence the major defects of marks of examiners. They highlighted 
the need for reliable and valid examinations. 

The disturbing facts revealed, by the enquiries mentioned above, led 
also to efforts to try and improve and reform the traditional type of exami¬ 
nation. 

The main characteristics of a good examination are reliability and 
raliclity. Reliability can best be defined as consistency. An instrument 
that measures consistently is reliable. Thus, taking an example from ordi¬ 
nary life, a tape measure as a means of measuring length or height is obvi¬ 
ously a more reliable instrument than a piece of elastic. Validity is best 
defined as “the extent to which a test or examination does what it is designed 
to do." 

The concepts of reliability and validity will become clear if the relation¬ 
ship between them is illustrated . 

.A test can be perfectly reliable and yet iinalid. Thus, for instance, if 
English Composition is marked by the number of words written the measur¬ 
ing instrument would be perfectly reliable but the purpo.se of the examina¬ 
tion namely, to assess linguistic ability, communication of adequate and 
relevant ideas and clear and appropriate arrangement of subject matter, 
would not be achieved and. therefore, the examination would not be valid. 
In designing an examination, therefore, emphasis must not be laid on relia¬ 
bility to the deteriment of the \alitUiy of the examination. The problem, 
therefore, of ensuring the reliability of an examination and not alTecting its 
validity must be the main pre-occupation of examination reform. 

India is moving from the stage of an educated elite towards that of an 
educated society and there.is no force which can prevent this democratic 
movement. The explosion of numbers in our examination system is a stark 
fact. Reform, therefore, in the .system of examinations must be based on the 
increasing use of statistical methods. As far back as 1962 a Committee of 
the University Grants Commission in their report on Examination Reforms 
recommended 

"The present methods of marking examination scripts and of combin¬ 
ing and tabulating marks in university examinations without reference 
to recognised statistical procedures arc not satisfactory. The proce¬ 
dures will have to be developed to make marking and combining of 
marks more objective." 

Two problems are thus raised ; 

1. methods of coordination of the marking of scripts in individual 
subjects; 

2. combining of marks secured by a candidate in dilTerenl subjects 
offered by him. 

These problems are accentuated and magnified in mass conducted exanii- 
nurions in which thousands, nay lakhs, of candidates are involved. 

The first issue, namely, marking of scripts in individual subject in an 
examination conducted for a large number of candidates raises the age-old 
question of the .'■ubjective element entering into marking and, therefore, 
invalidating the marks of examiners bccaure they arc not comparable. Sta- 
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ted in another way, it means that if the same scripts are given to diiferent 
examiners it will be found that the marks given by them vary very conside¬ 
rably. The problem then is how to remove the subjective element and bias 
oF individual examiners. 

standardizing tXAMINLRS 

Before dealing with the statistical procedure required to remove the 
subjective element and bias of individual examiners in the marking of scripts, 
certain refinements in the setting, moderating and marking of scripts will be 
considered to help in this process. 

As the preparation of a question paper is a time-consuming process, 
ihe work should start over a year before the date of the examination. 

The first procedure is lo draw up a blue-print of the question paper to 
be set. so that the validity of the examination in that subject is achieved, 
that is, the purpose of the examination is ensured. The blue-print w'ill 
iiiilicatc the proportion of marks to be allotted to the areas of knowledge, 
.skills, concepts, etc , which arc to be tested. Thus, in *Geography a blue¬ 
print might be drtiwn up thu.s : 


Hoha\ joiir 


tniiiini 
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L nder- 
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Relevani 
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fi 

4 

20 


21 


20 

ir 

20 
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The Chief examiner or the paper :ieiier must base his questions on the 
bluc-pritu taking into consideration the .scope of the syllabus, whether the 
question papers are of equivalent standard to the question papers of the pre¬ 
vious years, the age group of the candidates, the number of years of studs 
for the prescribed course and such other relevant factors. 

In drawing up this first draft the chief examiner should be assisted by 
.‘'cnior colleagues. This draft must then be sent to a moderaior whose func¬ 
tion is to safeguard the point of view of the candidates who are taking the 
papers. He mu.st ensure that the papers are technically correct and that 
they are a fair and sufficient test for the candidates for whom they are intend¬ 
ed. The moderator must submit a report on the draft question paper. 

Thereafter, the report must be considered at a meeting of the chief 
examiners of the different papers in that subject, the moderator and expe- 

‘Adapied from Examinations Bulletin No. 3—The Ceriificates of Secondary Edu- 
elion; An introduciion lo some tcchniqiic.s of e.Viimining-Secondary School Exami- 
nulions Council. England. 
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rienced senior examiners. If necessary, questions may be rejected or modi¬ 
fications carried out in accordance with the decisions taken at the meeting. 

New versions of questions must again be submitted to the moderator 
and, if necessary, another meeting of the chief examiners in the different 
papers in that subject convened till agreement has been reached on the final 
form of the paper. 

It is important that in subjects where problems are set e.g. in the sciences 
and mathematics, assistant examiners who have not been responsible for 
drawing up the questions or reviewing them should be given the task of 
working the draft questions and providing solutions. The difficulty of the 
problems and the validity of the time allowed for the paper are thus tested. 

A.fter this and before the examination begins, the chief examiner with 
the help of senior colleagues must draw up the scheme of markingwhich will 
be used by all assistant examiners. The scheme will vary in length and in 
detail according to the nature of the subject and the paper. In general 
the scheme should set out the principles of marking which are to be observed, 
maximum marks which are to be allotted to the various questions, steps of 
working and the points or versions which are to be rejected or accepted. 
Thereafter, the scheme must be circulated to the assistant examiners to he 
studied by them. 

When the scripts have been received, ihe chief e.vaminer must mark a 
certain number of scripts, .select specimens which are Ivpical of the various 
.standards of attainment or which illustrate points of parlicular interest. 
Photographic copies of these specimens must be supplied to assistant exami¬ 
ners and then a co-ordination meeting of all examiners must be summoned. 
The meeting will discuss the scheme of marking, which may be amended or 
added to in the light of the .scripts which have been seen. The specimen 
scripts will then be marked independently by all the assistant examiners, the 
discrepancies discussed and investigated and rulings given b> the chiefexami- 
ner on doubtful poiiils. 

The assistant evaniiners then begin the proces.', ol' marking, follow iiig 
the marking scheme with the aid of the specimen scripts. Where the number 
of candidates is large, for every four or five assistant examiners a senior 
examiner known as a -tcara leader’ should be appointed to scrutinize the 
marked scripis of the assi.stanl examiners. These in turn should be sub¬ 
mitted to the chief c.xaminer who reviews the sample scripis of the assistant 
examiners and. if necessary, holds discussions with the team leader and 
assistant examiners. The whole purpose of the processes de.scribed above is 
to standardize the examiners. 

Other factors, which will help in the standardization of examiners arc 
fair remuneration, a limited number of scripts Cnot more than 300 to 400j, 
a fixed number of hours of marking in properly ventilated and. if necessary, in 
air-conditioned rooms. 

IIANDOM SLLLCTION OF .SCJtlPls 

However, ihc.se factors will not eliminate the subjective element of 
individual examiners. One of the main factors which brings into play the 
subjective factor is the quality of scripts which an examiner is expected to 
mark. Inspite of the detailed marking scheme, good working conditions, 
adequate remuneration, a lighter load of scripis, examiners are alTectcd anil 
influenced by the quality of scripis they arc required to mark. If the ave- 
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rage quality of scripts to be marked by examiners is good, then the poorer 
scripts, by comparison, will be marked strictly. 

Ou the other hand, if the average quality of the scripts is sub-standard 
then the scripts which would otherwise be of average quality are given marks 
which would normally be given to good scripts. 

The first need, therefore, is that the different examiners get scripts which 
are more or less of equal average quality. It would seem that this problem 
is not easily soluble because until scripts are examined it will not be possible 
to predict their average quality. There is, however, a basic statistical prin¬ 
ciple that can be invoked to solve this problem—the principle of “random 
selection'’- If scripts to different examiners are allotted on the basis of a 
process equivalent to drawing up lots and (lotteries are not fashionable !) 
ihen the lots given to different examiners will be approximately of the same 
average quality. 

There are two important statistical factors in the principle of “random 
.selection" which will determine a common pattern of marking and will 
reduce the subjective element. These are; 

(f) that in lots of three to four hundred scripts it will be found that the 
mean (average markj or the median (middle markj of the different 
lots of scripts will lie between a narrow range of two to three marks, 

(/(■) the range or spread of marks (the lowest mark scored and the high¬ 
est mark secured; will not vary ver\- greatly from one lot of scripts 
to another. 

Thus, if there arc great s ariations in the mean or median mark or in the 
range or spread of mark's, it will mean that the subjective bias of the e.xami- 
iier.s is dominant, and therefore, it will be statistically justifiable to scale the 
marks given by the e.xaminers to conform to a common pattern. 

.Antoher important statistical axiom which justifies the scaling the marks 
of examiners to a common pattern is that where there are scripts of several 
ihouisands of candidates, tauligt in a large number of schools, by hundreds 
of teachers, it is mathematically sound to conclude that the standards of 
teaching, the quality and the preparation for the examination cannot show 
wide iluctuations froin one year to another. Any \ ariations found from 
year to year cannot be attributed to \ariations in teaching or the intelligence 
or attainment of candidates but in the standard of the question papers, 
the standard of marking and other concomraitanis of the examination. 

XDJL'STING me M.XRK Or DIFFERENT EXXMINFJIF 

All experiment was made by Gaiihuti Uniiersity on the adjustmeni of 
the marks of different examiners. 

This study helped to highlight that chance in ihc coinentional exami¬ 
nation iv far greater than has been prciiously suspected on account of un¬ 
predictable variations between the standards applied by diflerent examiners. 
It did also show that the scaling of marks can compensate for these vaha- 
lons and in the words of the report, "that the marks thus awarded can result 
in greater validity than would otherwise be possible". “By scaling is meant 
the adjustment of marks to a common pattern. It has long been recognised 
as a necessary procedure, for examination results mean little or nothing 
when candidate A is judged on one standard and candidate B on another". 
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The Gauhati University investigation was based on what is termeil 
‘median scaling’. To quote the report again, “If all the marks on the sheet 
are taken in order of magnitude beginning with the highest and ending with 
the lowest, the middle mark is the ‘median’. The median divides the group 
of marks into upper and the lower half with the same number of entries in 
each. In the same way, the upper quariile is the middle mark in the top 
half and the lower quartile is the middle mark in the bottom half.” 

“The mean is a measure of the standard of marking. It is the mark 
ss’hich the examiner gives to a script of average merit.” 

In other words, the average of the median mark of the dilTerent exami¬ 
ners is worked out and treating this as the norm for those cases where the 
median mark of an examiner differs from the norm beyond a certain range, 
the marks in the whole lot of scripts marked by an examiner arc adjusted, 
that is to say. raised or lowered proportionately. 

But, it should be noted that the Gauhati University investigation adjust¬ 
ed the marks of the different examiners in the median marks only and noi 
in the spread of marks. 

The report it.self states : 

“Mark sheets differ not only in the value of the median, but also in the 

spread of marks.The spread is measured by the standard deviation 

which is approximately three-quarters of the intcr-quartile range." 

The report continues; “Ideally marks should be scaled so that all 
sets of marks have (o) the same mean or median and (h) the same standard 
deviation. Of these (h) presents the more difficult problem, which needs 
further study-" 

In an article publishc.1 in the Indian Educational Review (January 
I968J, Professor V. M. Dandekar commenting on this observation of the 
report says ; 

‘•However, this is not entirely true. Two sets of marks having the same 
mean or median and also the .same standard deviation may differ in several 
important respects." 

He goes on to illustrate this and concludes thus; “The reason why 
two sets of marks with the same mean and standard deviation do not agree 
in several important respects is simple. As pointed out above, the mean 
and the standard deviation are particular measures of the average level and 
of the spread of marks. These measures would has especial significance only 
if the distribution of marks as given by examiners were perfectly normal. 
The term ‘normal’ here does not mean more than a particular form of staii.s- 
tical distribution. If the distribution of marks were perfectly ‘normal’m 
this sense, it could be shown that two sets of marks having the same mean 
and the same standard deviation would agree in all other respects." 

the J-EFFECl 

1 he marks of examiners, unfortunately, do not conform to a normal 
distribution curve. The Gauhati report draws particular attention to thi.s 
important aspect of the marks of examiners: “A prominent feature oJ 
many mark sheets has been called the ‘J-effect’, since it often gives a J-shapetl 
distribution. In these mark sheets a disproportionate number of scripts are 
placed exactly at the pass mark and there is a corre.sponding gap in the mark> 
immediately below.’’ 
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“The J-elTect arises when the examiner considers Jt his function to decide 
whether the candidalc passes or not. Recognising, perhaps righty, that his 
marks are affected by uncertainties, he gives the benefit of doubt to the 
candidates whose marks are Just below the line.” 

“In adjusting border-line cases the examiner is actuated by a perfectly 

sound motive_but here it is being done at the wrong stage. It is essent- 

tial that border-line adjustments shall be made only in the light of the total 
evidence when the results are complete.’" 

function of raw marks ; rank ordering 

Before suggesting and analysing a method of adjusiing marks to over¬ 
come the shortcomings pointed out by Professor Dandekar, it may be well 
at this point to examine the purpose of the raw marks awarded by examiners. 

At the out.set it must be made clear that the awarding of numericalmarks 
by the examiners is absolutely essential in the examining process. The mark¬ 
ing scheme must be strictly followed, so that if there are variations in the 
marks aw'arded for a question or a different parts of a question, these should 
be reduced a minimum. It is important to remember that marks, being 
relative, must be regarded as aids in measuring rather than as absolute mea¬ 
sures in themselves. 

The primary and perhaps the only purpose of awarding marks, whilst 
an essential process in an examination, is a ranking procedure which places 
candidates in a particular order relative to one another. In other words 
we accept the rank order indicated by the marks given by aparticular exami¬ 
ner and this rank order must not be distorted by any subsequent procedure. 
It is necessary to repeat that the assigning of numerical marks to scrip's by 
an examiner is a necessary step in the examination process and it is not 
suggested that this assigning of numerical marks should be abolished. 

However, once the examiner has indicated the order in which these 
scripts are to be placed, the value of the marks assigned by him are not 
relevant. 

A SIMPLF METHOD OF MARK DtSTRinUTtON 

We now return to the best means of adjusting the marks of differem 
examiners taking into account the comments made by Prof. Dandekar. 

Prof. Dandefcar's own suggestions (and that adopted with modifications 
by a large number of examining bodies) arc given below : 

"The distributions of marks as given by examiners are usually not 
normal and often they are far from being normal. Linder the.se conditions, 
it may be advisable to adopt certain measures which are more direct de.scrip 
tions of the pattern of distribution. The simplest anil most direct description 
of a pattern of distribution is to indicate the number or proportion of candidates 
ii'/io have secured marks between certain ranges." 

The study of Table I. which must be considered merely illustrative, 
will clarify the proposition just enunciated. 

The table gives the ranges of marks iColumn A) and against each range 
or group of marks the percentage of candidale.s securing those marks 
(Column B): 




TABLr, I 


(A) 

Range of Marks 


(B) 

I'ci'Lxntage of camli- 
daLcs 


80 and abiive 


70-79 8 

63-69 ID 

59-62 14 

55-58 16 

50-54 20 

45-49 10 

40-44 10 

39 and bclort .. .. 10 


If all the examiners marking independently within the marking scheme 
and, without adjusting their marks, get the same percentage of candidates 
in each range or group of marks as shown in Table 1. then we w ould ha\e 
a pattern of distribution of marks which will be identical and which 
would make the marking ideal. Quite obviously, it is not possible for c\en 
two sets of marks of different examiners, mainly because of the subjective 
factor, to agree in respect of proportion of candidates falling into each 
group of marks, as we would desire. How then can this pattern of distribu¬ 
tion of marking of different examiners be achieved? 

The simplest method and the method which is mathematically correct 
is to adjust the marks given by each examiner so as to bring the pattern 
of his marking into conformity with a common pattern which musi be 
determined, as for instance, as given in Table I. 

The next question that arises is how are we to determine with mathe¬ 
matical precision the percentage of candidates falling within each range ol' 
marks. This may be done as follows; After all the examiners have marked 
their lots of scripts (based on the principle of random selection) their n 1 ark^ 
may be pooled together and distributed for each range of markc 

Thereafter, the marks given by each examiner should be adjusted so 
as to bring the pattern of his marking into conformity with the common 
pattern. This procedure suffers from one grave defect, in that the adjust¬ 
ment of marks of individual examiners cannot be carried out until all the 
scripts have been marked. In practice this may lead to a considerable 
delay in the declaration of results. 

It may also mean that there will be a variation in the results and, there¬ 
fore, of standards, in a subject, from year to year. In order to prevent the 
delay in the operation of the sytem and to avoid wide variations in the re- 
results from year to year, the simplest method would be to establish the per¬ 
centage of candidates in each range of marks for each subject based on the 
norms of past years, say five years. Thus, actual marks given by all examin¬ 
ers in the past five years can be distributed and the proportion of candidates 
falling within each range of marks, such as 80 and above, between 70 and 
79 etc., etc., may be worked out. These can then be the norms which would 
serve for some years, subject to periodical revision. 
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To recapitulate the process of adjustment of marks will involve the 
following : 

(i) determination of the proportion of candidates falling within each 
range of marks; 

(/■;■) ranking the numerical scores of each examiner in a descending 
order of marks; 

(Hi) scaling the rank order of each examiner to conform to a common 
pattern. 

assigning grades 

Having adjusted the marks of the different examiners to conform to 
a common pattern of mark distribution and after ranking the scripts examin¬ 
ed by each examiner in a descending order of the marks given by them, 
the top 2 per cent are given the letter grade A or number grade 1, the next 
8 per cent are given letter grade y42 or number grade 2, and so on (see Table 
2). This ensures that the rank-ordering of the scripts is not distorted. 


T\iiLi 2 


(Al 

(H) 

IC) 

ID) (E| 

Riinpe of Mark> 

I’crcenlagc 

I.euer 

N'umbtr Slandard 


of candi' 

Ciiade 

Grade 


diitcs 



.SO and above 


Al 

1 1 X'erv pond 

•’(I-IU. 

8 

.a: 

t 1 


10 

III 

3 


14 

h: 

4 Credii 

55-5H 

l(> 

Cl 

5 1 

.so-.s.) 

;o 

c: 

M 

-lS-44 

10 

ni 

T 1 Pavs 

40-44 

It) 

n: 


anJ hclo^^ 

10 

r 

4 Fail 


It should, howeser, be made clear that the examiners must not be asked 
10 allot grades rather than numerical scores. The numerical marks given 
by examiners are essential. It is only after the scripts ha^e been put in a 
particular ranking order, on the basis of the marks assigned by each exa¬ 
miner, that the grades may be assigned. 

It should be emphasized that the percentages for each range of marks in 
Tables 1 & 2 arc purely illiisirative. 

•^ORMS IN DIFFERENT Sl'HJECTS 

The attempt in this paper, so far, has been to find ways and means of 
ensuring the comparability of marks of different examiners in a subject. 
Certain methods on the establishment of 'norms' for the distribution of 
marks in a subject have been suggested, namely, pooling the marks of all the 
examiners in the current and taking the 'average' as the pattern of distribu¬ 
tion or basing the pattern of distribution on the past four or five years. 
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Arising from this is another relevant and important question: should the 
pattern of mark distribution be the same for different subjects? 

At present in a large number of examinations in India not only are the 
pass percentages in a certain subjects, specially the humanities lower than 
those in the sciences and mathematics but he numerical marks are also 
disproportionately lower. There is no real justification for this. 

if the examiners feel that a higher percentage of passes and higher 
'scores’ are not justified on their past experience, then it would clearly indi¬ 
cate that where candidates are permitted to “opt' for subjects there must be 
some defect in the curricular burden of the humanities subjects. This must 
be examined. If, however, the disparity in pass percentages and numerical 
scores is due to the fact that examiners are not using the full marking scale 
(.0-100) in assessing the scripts of humanities subjects, the immediate remedy 
is obvious. 

Different pass percentages and mark distribution pattern in elective 
subjects where there are large numbers of candidates is not logical nor justi¬ 
fiable. 

On pedagogical grounds it is hard to resist the logical conclusion that 
the pass percentage and the pattern of mark distribution should be more 
or less the same for all subjects. 

Combining grades of different subjects: The second problem posed 
earlier was that of combining of marks secured by candidates in diftercnl 
subjects offered by them. 

There are well-known statistical procedures for converting grades into 
marks. In Table 2 number grades have been suggested, in addition to 
letter grades. It is possible by means ofa grade aggregate to classify candi¬ 
dates into first, second or third divisions. Thus, on a five subject pass, 
assuming that the subject and other requirements laid down for a pass are 
fulfilled, the following scheme (using the range of marks given in Table 
2) which is used for the Indian School Certificate Hxaminaiion. may .serve 
as a guide: 

A grade aggregate not exceeding 19 Division 1 

Grade aggregate 20 to 28 Division 2 

Grade aggregate above 28 Divi.sion .8 

However, it cannot he too strongly recommended that the final result of a 
candidate should consist only of the grades secured by him in each subject in 
which he passes. The report of the Kothari Commission says: "We recom¬ 
mend that the certificate issued by the board on the basis of the results of 
the external examination at the end of the lower or higher secondary stage, 
should give the candidate performance only in tho.se subjects in which he 
has passed, but there should be no remark to the effect that he has passed 
or failed in whole examination." 

CONCLUSION 

The attempt in this paper is to show that the numerical mark assigned by 
an examiner is an indicator for rank ordering of scripts only and has no abso¬ 
lute value. 
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The paper recommends that statistical procedures be increasingly used 
to ensure comparability of mark's of examiners in individual subjects and in 
different subjects. The procedures suggested are the allocation of scripts 
on the principle of random selection, the scaling of marks based on a com¬ 
mon pattern of mark distribution in the same subject, the adoption of a 
common pattern mark distribution in different subject more especially 
elective subjects and the recording of ‘grades' only in the final certificate 
issued without dubbing candidates first, second or third c\a.is\ 
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Sea'ing o:’ !lesu.ts 

M. D. TRIVEDI 


MARKING 

All techniques or evaluation including cxaniiiiatioiLs are pioceAse,s ol' 
collecting evidences about students' development in desired directionv 
We realise that the external examinations will remain with us for a long lime, 
especially in universities which have large number of affiliated colleges of 
very unequal standards, as Kothari Education Commission puts it. Through 
such a conventional examination, a student's performance on attainment 
is measured. The marks awarded to a student, it is said, tell us how much 
he knows and understands or his level of competence. Do these marks 
really do so? 

We add marks scored by different examiners together without an\ 
reference to the scales to which those marks refer. In the words of Dr. 
H. J. Taylor, it is as though the physicist added Fahrenheit and centigrade 
temperatures of the accountant added rupees and dollars. Such vitiation 
of examination results by arithmetical fallacies makes them unreliable. 
Marking is a complex and difficult problem. As Thorndike said, "Measure¬ 
ments which involve human capacities and acts are subject to special diffi¬ 
culties due chiefly to: 

(0 The absence or imperfection of units in which to measure. 

( 1 ) The lack of constancy in the facts to be measured, and 

(3) The extreme complexity of the measurcmeiils to be made." 

This is not to say that no new marking system, however, clearly devised 
and conscientiously followed, is likely to solve the basic problems of mark¬ 
ing. In the meantime we should learn to use the present instrument more 
intelligently. 

An examiner measures the performance of a candidate by assigning 



marks to his answer scripts. A mark, however, imprecise, is essentially a 
measure number, subject to uncertainty. The mark may be a measure of 
the candidate’s knowledge or memory or intelligency or power of expression 
or sometimes his handwriting. In any case where human judgement is 
involved, margin of error becomes wider, which results in wide variations in 
marking. 

Marking standards and the meanings of marks tend to vary from exa¬ 
miner to examiner, from course to course, from faculty to faculty and from 
university to university. 

Harper Jr. reports in his research ‘Ninety marking ten a study of exami¬ 
nation’, that different experienced examiners award different marks to the 
.same answer book to the extent that one examiner awarded a distinction 
while another considered it worthy of only 22'^,o marks. Dr. Taylor also 
arrived at the same sort of results in his study on the examination of exa¬ 
miners. This shows that it is risky to depend entirely on the judgement of 
one examiner. He has further shown that even a single examiner may .show 
considerable changes in his standard of scoring as he works through the 
scripts to the extent of 10",, marks. Large variations in standard of scoring 
seem to be the rule rather than the exception, as Dr. Taylor puts it. 

If we comment on the state of affairs, lack of uniformity in scoring 
LIS reported can he ascribed to the traditional essay type of examination 
rather than to the examiners. It should be rea!i,sed that subjectivity of scor¬ 
ing is not the major defect of traditional examinations. Even if scoring 
were eoniplctely objective, the traditional examination would still be un¬ 
reliable. 

roRM oi gi LsnoN and scoring ruliabiliiv 

The .subjectivity of scoring can be minimised by introducing objective 
type of examination. Ilesidcs its objectivity of scoring the objective exami- 
niilion is more reliable for various other reasons. .As Dongerkery Com¬ 
mittee on University E.xamination Reform suggests, use of methods of eva¬ 
luation other than essay type examination such as multiple choice tests, 
short-answer tests, open book tests, viva-voce. etc., may be tried wherever 
necessary. The essay type of examination may continue as the chief mode 
of evaluation in our universities, it is necessary to make it a fitter instrument 
for measuring the educational achievement of the students. As w'e are 
aware, essay type examination suffers from the defect of its poor sampling 
of the student's knowledge and ability, its very inadequate coverage of the 
subject-matter and the faulty form of the questions. .An objective exa¬ 
mination is an answ’er to these shortcomings. Attempt should, therefore, 
be made to improve questions, question-papers, scoring procedures and 
interpretation of scores in order to make the examination valid, reliable, 
objective and praticablc. 

Questions should be made specific in terms of objectives, content and 
language. Form of question should be suitable for testing the objective 
and the content area most effectively. It must have a desired difficult index 
and should discriminate between the bright and poor students. Better ques¬ 
tion papers can be set by giving proportionate weightage to objectives, con¬ 
tent areas and different forms of questions like short answer type, multiple- 
choice type, etc. Overall options should be avoided. Internal options with 
equivalence of questions may be preferred to overall options. 
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With a view to increasing scoring reliability, scoring procedures need 
improvement. The paper-setters should be instructed to develop a mark¬ 
ing scheme along with the setting of the question paper. The marking 
scheme has a design and contains value-points for each question against 
which marks are shown in the scheme. Suitable instructions to examiners 
in this regard help to bring about uniformity of standing in scoring. 

COJRRECTIONAL SCORE AND RELIABILITY OE EXAMtNATION 

In a study sponsored by the National Council of Educational Research 
and Training it was found that the same candidate was awarded a distinction 
by one examiner, a first class by 8, a second class by 41. a third by 33 and a 
clear fail by 7 experienced examiners. Apparently, examiners were not even 
clear about the difference between ‘Dinstinction" and ‘Fail'. As several 
researches have pointed out, the marks or even the divisions of a candidate 
depend more on the chance of who his examiner is than on the candidate'.s 
actual merit. 

Statistically interpreted, different examiners show wide variations in 
mean and standard deviation of the scores. It is therefore imperative 
that marks should be scaled to the same mean and standard dev iation before 
being combined, otherwise large errors will vitiate the results. The Don 
gerkery Commission also observes that the present method of marking exa¬ 
mination scripts and of combining and tabulating marks in iiniversilv 
examinations without reference to recognised statistical procedures arc not 
satisfactory. 

Normative scaling methods may be used to scale the results. They are 
(i) linear transformation and (ii) the area transformation. 

If the mean and standard dev iation of the scores are known, the devia¬ 
tion of any score from the mean can be expressed as a multiple of the stan¬ 
dard deviation. Such a score is commonly known as a standard score or 
Z-score. Scores are scaled to a mean 50 and S.D. 10. Since standard 
score is derived by dividing a deviation from the mean by the standard de¬ 
viation, both of which are in the same unit, it is an abstract quantity, that is. 
a quantity independent of the original measurement unit. The shift from 
raw score to standard .score requires a linear transformation. 

If scales were constructed so as to yield distributions of some "standard' 
form for the populations involved, then standard scores could always be 
interpreted with reference to the 'standard' form. The standard form or 
pattern usually is normal distribution and the transformation is called area 
transformation. This scheme is in one sense a combination of the percen¬ 
tile rank and standard score approached. These normalised standard 
scores are T-scores. Since T-scores are based on the Z-scores of the normal 
curve, the T-scores of two or more distributions are always, comparable 
and oombinable—Z-scores are comparable and combinable only, if the dis¬ 
tributions are normal. T-scores can always be interpreted without error in 
terms of percentile ranks. 

It is interesting to note how the results expressed in raw scores show a 
marked change when scaled in either of the ways explained riz. Z-score or 
T-score. An analysis of the results of the B.Ed. examination for I96K 
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of the Saurashtra university reveals the follwing picture ; 


Diviiwm ari urding In T-Si iira 




No. 

D;.si. 

Firsi 

.Secund 

I’ab.s 

Fall PerLCiuase 



31.1 

3 


104 

147 

37 S!i 2 

Divisions 

Dislinc. 

10 

1 

6 

1 



According 

Firsl 

5H 


16 

42 



10 ra\N 

■Sccunil 

21 1 



61 

137 

13 

scores 

Pass 

. 1.1 




10 

23 


Full I 

IViLcniagc 
Rl'suIi yy 7 


From the above table, it is evident that conversion of result from 
raw scores to T-scores afTecls the classification. Out of 10 placed in dis- 
linction only 3 keep up the division whereas 6 get first and 1 second division. 
Figures in the boxes show the number of candidates maintaining the divi¬ 
sion after scaling. Wide changes in the classification in general can be mark¬ 
ed thus bringing the result from 99.7% to 88.2",,. Dr. Taylor and Flarper 
Jr. have also arrived at similar conclusions in their studies on examinations. 

In large examinatioivs. differences in the mark-distributions can be 
uiiributed to the examiners which can be corrected bv scaling. The tech¬ 
nique by which the marks of the examiner are adjusted until the mean and 
variance are approximately the same can be adopted. 

In order to increase the reliability of the results, it is important that the 
distribution of the answer scripts should be random and the marks should 
be scaled. 

Practice of moderating the answer script and giving ’grace mark' should 
also be viewed in this light. Instead of having any arbitrary principle of 
grace marks, it must be done with reference to the standard error of mark¬ 
ing. The probability can be computed that the total mark falls above the 
pass line. All the candidates for whom this probability reaches the speci- 
lied value should be passed. Adoption of such procedure of scaling w ould 
result in increasing the scoring reliability ereatly and in a higher percentage 
of pass, thus obviating lailure on account of examiner's errors. Studies on 
large examinatins have shown that the aggregate total mark is more reliable 
than any of the single papers, as some of the sources of unreliability tend to 
average out. 

IN CONCLUSION 

We have seen several examples of the unreliability of the traditional 
essay type examinations. Problems highlighted include marking system, 
lorm of question and question-paper and the misclassifications on account of 
examiner's errors. Ways of uniform scoring, improvement of the form and 
content of the question paper by adopting objective examination and the 
rieed and method of scaling of result have been suggested. Every univer- 
■vily should set up an evaluation unit of its own. adequately staffed with 
administrative officers and academicians who are technical experts in the 
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field of evaluation and statistics. If the idea of continuous evaluation in¬ 
stead of a single examination season is to be implemented, such an evalua¬ 
tion unit should be well organised and administered on a permanent basis. 
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Scaling o: lam 

MS. MISRA 


WIIAl IS MALIN(j'.’ 

■SifFuSL wi- ASK : “The Icngih of article A is 50 (?J and ofB is 5 (?). Which 
one is longer?" This question cannot be answered, We may make the 
quesiion precise as; "The length of article A is 50 centimeters and of B 
5 meters. Which one is longer?" To solve it. we convert the lengths of 
both the articles to the same scale. We find that the length of article A is 
50 centimeters and of B (5 meters converted to centimeters) 500 centi- 
iiiciers. So we conclude that article B is longer than A. Two numbers 
cannot be validly compared unless they are converted to a common scale. 
The conversion of numbers to a common scale is called scaling. 

'\uv StALL IXA'IINAIION .MAJIKS? 

Some imiversiiics award a prize to ihe student who gets the highest 
marks in an examination. This prize usually goes to a student with Mathe¬ 
matics and virtually never to a student with English. Does it mean that 
usually brighter students go to Mathematics and not to English? No. 
ihe reason is something else. While in Mathematics any bright stu¬ 
dent can expect to get 100“' marks, in English none. This means that 70 
law marks in Mathematics are not the same as 70 raw marks in English. 
(For further discussion of this point see Harper. 1963). Again, even in 
English 70 raw marks awarded by one examiner (who often awards 70— 
HO marks) is not the same as 70 marks awarded by another examiner (who 
has never in the past awarded more than 60 marks). To make the point 
clear we reproduce below the results given by two competent examiners in 
English If of the Matriculation examination 1963 conducted by the 
Gauhati University. Both the examiners had examined statistically equiva¬ 
lent sample of scripts. 



Examiner X 60% passes 
Examiner Z 2% passes 

If the marks are unsealed, examiners X and Z will be treated as of the same 
standard with the result that some good students examined by Z will fail 
and some weak ones examined by X will pass. 

One major purpose of an examination is to rank students in the order 
or merit. This cannot be validly done unless the marks of different exami¬ 
ners and of different papers are brought to a common scale. In the absence 
of scaling this very purpose of examination cannot be validly achieved, 
hence the need for scaling. 

We shall consider scaling under two broad heads: Intra-subject scaling: 
i.c.. conversion of raw marks of different examiners of a paper to the same 
scale. Inter-subject scaling: /.i'., conversion of raw marks of differeni 
subjects to the same scale. 

INTRA-SUBJECT SCALING 

Eor scaling we must be satisfied with either of the two conditions: 
fl) The lot of answer scripts examined by all the examiners are equivalent. 
(2) There exists accurate estimate of the distribution of abilities in evers 
batch. 

RANDOMISATION 

Though it IS somewhat diflicult to .satisfy the second condition, iis 
feasibility cannot be ruled out. The first condition can. however, be ca.sil\ 
met by any examining bod\. It is to satisfy this condition that the Gauhafi 
university has introduced ''randomisation of .scripls"in its major examina¬ 
tions. The method of randomisation is very simple (Taylor. I96?|. This 
has an additional advantage that any mistake in awarding roll numbers 
can be easily traced which i.s not possible without an arduoii.s search in the 
ideal procedure of randomisation, which means drawing of numbers from 
a hat. Tt seems well to illustrate step by step how randomisation is actually 
done. To make the arithmetic of the illustration simple, we shall suppose 
that there are just five colleges each with eleven students and there arc three 
examiners—A and B getting 18 scripts each and C getting 19 scripts. 

Step I. On the printed grid of the type enclosed herewith distribute 
roll numbers by writing them coasccutivcly in the diagonal order from the 
top left hand corner rev ersing the direction at the boundary lines and jump¬ 
ing over cells already filled. When the sequence ends at a corner, the 
next start is made from a vacant corner. When this sequence also end.', 
the next start is made from the first vacant space in column 1, For the 
55 students a filled Ingrid is shown in Table I .* 

Step 2. Allot roll numbers to the colleecs column by column. This 
is shown in Table 2.“ 

Step 3. Allot the scripts in the serial order of roll numbers to the 
examiners. This would be as noted below : 

Examiner A Roll Nos. I—18 — 18 scripts 

Examiner B Roll Nos. 19—36 = 18 scripts 

Examiner C Roll Nos. 37—55 = 19 scripts 

55 


*Tablc I and II arc on pni’.c I4‘) please 
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It may be seen from Table 2 that examiner A gets Roll Nos. J, 2 and 
18 from college I; 3, 4, 16 &. 17 from II; 5, 6, 7 & 15 from III; 8, 9, 10 
& 15 from IV; and 10, 11, 12 & 13 from V. Thus he gets approximately 
equal number of candidates from every college. L'nder this method we 
may, therefore, safely assume that every examiner gets a fairly representatis e 
sample of the total examinees. An empirical study (Misra, 1970) corro¬ 
borates this assumption. 

Randomisation has several other advantages. If the scripts of an insti- 
iLition go to one examiner, it may be possible for an examinee to locate 
his examiner or for an examiner to know who are his examinees. We do 
not know to what extent ihis knowledge produces error in assessment. But 
il is always safe to have a method where the scripts of an institution go 
to almost all the examiners and thus complete anonymity about examiners 
and examinees is ensured. Ttirther. the quality of an institution is generally 
judged by its examination results. Where the scripts of an institution 
go to many e.xaminers. no institution is likely to be penalised or rewarded 
because of the strictness or leniency of examiners. Research has shown 
iliai ft'r any popti'ation the distribution of abilities is normal. Since in 
tills system every batch is a represemaiive sample of the population, we 
may assume that’not only all the batches are equivalent but also the actual 
vlistributiJii of abilities in each approximates normality. 

The procedure of randomisation appears to be difficult but in practice 
we have found that even office assistants can tkv it efficiently. Besides, it 
IS not essential that every year vve prepare a set of random roll numbers. 
\V e may gel in advance a’fcw sets prepared and use any whenever necessary 

St ALINC. 

Many methods tif sc.iline have been suggested in India (Mahalanahi.' 
and Cliakravariy. 193-1; Ho.ssain. 1940: Bose and Choudhtiry. I9.>5; Gaycn 
cl III.. 1961; Taylor. 1963; Haips'r. 1963). V\’e shall discuss here the method 
which seems to be most appropriate to vvur situation and easy. 

(A) Insiniiiiuii.\ to c.xwiiiiwrs lor inarkniy : Several studies done by 
ihe pre.sent author and others in India have shown that some examiners 
give a few low inariss and many high marks, some others do just the reverse. 
In cither ease the distribution of marks is highly skewed. .•Mniost all the 
examiners have a tendency to produce the J=elTect I i.r. they pile many 
cases at various division levels, especially at the pass level, with gaps below 
'Lich levels). In fact every examiner has in mind some vague spectlications 
about the distribution of marks of an ordinary batch. No two examiners 
have the same specification in mind. Probably it is one of the reasons )br 
large variations in marking scales of different examiners. In the absence 
of randomisation there is no clue to find out how abilities are actually distri- 
Iniicd in any lot but after randomisation the distribution of abilities in the 
lots may be specified. The examiners may be told that the distribution of 
marks in each lot of scripts should be roughly normal with mean about 

-. and standard deviation about- — -.The 

pass percentage is expected to be around The 

figures ill the blanks may be filled on the basis of the past results. Examina¬ 
tion of the scripts according to these specifications would narrow down 
the existing vviile disparities between the marking standards of difierent 
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examiners, and. as such, remove many uncertainties that creep in the exami¬ 
nations due to such disparities. 

fB) What batches need scaling ? After raw marks from the examiners 
are received they are to be scaled. For scaling we recuire an estimate of 
the population parameter. Research has almost cone usively shown that 
for a large population, a population parameter does not change significantly 
from an year to the succeeding year. Thus the parameter for the preceding 
years examination may be taken as the best e.stimate of the population para¬ 
meter. Another method of the estimate of the population parameter could 
be to take the weighted average of the meaivs and variances of all the batches. 
We recommend the first method, since in this we do not have to wait for 
starting scaling till all the mark sheets are received. 

Even if all the examiners mark the .scripts on exactly the same scale, the 
means and standard deviations of all the batches may not be identical. 
There would be some differences due to sampling errors. The batches, 
where such differences are within the limits of sampling errors, need no scal¬ 
ing. The batches, where the mean, standard deviation, or both difl'er be¬ 
yond such limits, have be scaled to bring them within the limits. 

(C) Standard deviation scaling : This is the most widely used method of 
scaling and is best suited to the situations where scripts arc randomised. 
The formula for the standard deviation scaling is: 

X )4-(m m) 

Where x Ls raw marks, and X is scaled murk; 

m is raw mark mean and M is scaled marks mean. 

s is raw mark .standard deviation and S is scaled mark standard det lation. 

The following illustration will make clear the applieaiion of the rormuhi 
and the accuracy in marks we derive by using it; 

Harper and Misra (1970) got a set of 10 scripts (.X-erox copies) examinetl 
by ninety experienced examiners of a higher secondary board. To make 
the examining conditions realistic, the .scripts were .sent to the examiners 
during the summer vacation when they usually mark the Board'.s scripts. 
The same instructions for marking were given as are given by the board and 
the examiners were paid the board'.s rate of remuneration. Table 3* shows 
the raw marks awarded to the same ten scripts by examiners Nos. I.v and 6 
at the left hand side. The rlio fraak order corrclaliiin) for the two examiners 
is .81 which at the face value indicates a high examiner reliability. None 
the less, the mean of the diTerences between the raw marks of the two exa¬ 
miners is 14.1 Note, examiner 15 has pa.ssed only 10",, while examiner fi 
has passed 90"„ students. (The pass marks in the question paper was 15). 
The present author has lepealcdly observed (though in vain) that in the 
absence of scaling, reliability c.oeflicienis give a misleading picture of the 
reliance that can be placed on examination marks. The present one is a 
concrete case to illustrate the point. 

It may be repeated here that for scaling wc have to decide to what mean 
and standard deviation the marks are to be scaled. In the present case the 
marks of examiner 15 could be scaled to the mean and standard deviation of 
marks of examiner 6, or the marks of examiner 6 could be sealed to the 
mean and standard deviation of marks of examiner 15 or marks of both the 
examiners could be scaled lo some .other mean and standard deviation. 

*Tdb1c j is oil iiagc I4‘i I’lca'-e. 
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Presently we decide to scale the marks of examiner 15 to the mean and stan¬ 
dard deviation of marks of examiner 6. yf^c apply formula (1). The raw 
mark mean and standard deviation in the present case are 8.1 and 4.66 
respectively (i.e., the mean and standard deviation of marks of examiner 
15). The mean and the standard deviation to which the raw marks are to 
be scaled are 22 and 6.52 respectively (i.e.. the mean and standard deviation 
of marks of examiner 6l. Inserting these figures in the formula we get: 


X = X 
4.66 


+ 22.2 - 

= 1.4x -f 10.9 


^6.52 

k4.66 


X 8.1 


Thus raw mark 7 becomes ('1.4)7 10.9—21 and raw mark 5 becomes 

(1.4) 5+ 10.9=18. Similarly other marks can be scaled. (With the use of 
a calculating machine such conversion can be made practically in no time). 
The scaled marks for the two examiners are noted at the right hand side in 
Tabic 3. After scaling, the rank order of the students remains exactly 
the same. The examiner reliability, also remains unchanged. However, the 
average of the differences between the scaled marks of the two examiners 
IS reduced to only 3.9. For the unsealed marks the smallest difference was 
X, for the scaled marks the large.st is 7. The number of students passing 
the examination is the same for both the examiners for the scaled marks. 


Both were highly experienced examiners of the board, both worked 
under the same instructions, both knew that their marks are open to analysis 
as such most likely had taken every caution to enforce accuracy in marking. 
The present result may. therefore, be considered as indicative of what 
we may expect even from the marking of experienced examiners. The 
amount of injustice done to the students if one batch is given the raw marks 
awarded by examiner 15 and another awarded by examiner 6 can better be 
realized than described 


The standard deviation scaling is criticised sometimes on the ground 
that the distribution of scaled marks remains the same as that of the raw- 
marks. Hence skewness and "J-effect" produced due to the defective 
marking scales of examiners are allowed to remain after scaling. Again, 
due to the skewed distribution of raw marks, this method may give scaled 
marks beyond the ranee of marks allotted to the paper. After we hve 
randomised the scripts and specified the distribution of raw marks such 
criticisms would not hold good in our case. 

Sometimes it is said that scaling is not needed in such subjects as 
Mathematics. Physics, etc. because marking in these subjects is almost 
objective. Whatever little re.search on the precision of marking has been 
done in India (and also abroad) shows that in traditional essay examinations 
even in subjects like Mathematics marking is no less subjective, if not more, 
than in supposedly subjective papers like languages. Further, if in tradi¬ 
tional essay tests there are any papers where marking is objective, such 
papers would, under the proposed scheme, automatically not be scaled 
because in that event mark distributions in different batches would not 
exceed the limits attributable to sample errors. 

(D) IV/iy not to scale only means : In deciding the rank or division of a 
student in the examination, it is the standard deviation and not the mean that 
plays the dominant role. To illustrate the point we give below the means 
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and standard deviations for two esaminers who marked the same set of Ml 


.scripts in Mathematics: 

Mean 

Standard deviation 

Examiner X 

11.08 

8.45 

Examiner Y 

11.08 

9.50 


Here mean is identical ibr both the examiners but standard deviations are 
different. Jt was partly due to the dilference in the standard deviations 
that while examiner X gave up to II divi.sion examiner Y gave up to I. IT 
only mean scaling is there, these batches will e.scape .scaling. 

ISTnH-Si nJF.CT SCALINC. 

What has been stated for intra subject scaling holds good for inter- 
subject scaling. Inter-subject scaling may be safely employed in the case-, 
where a common batch has appeared for all the subjects to be scaled. When 
different batches appear for different subjects but still we may assume that 
the distributions of abilities in all the batches are equivalent, inter-subject 
scaling can be used. In the cases-where the assumption of equivalence of 
batches is not plau.siblc, scaling can only be employed if there exists some 
accurate estimate of the distribution of abilities in each batch. To explore 
an easy wav of such estimation further research would be needed. 

AnVIlStSTHMlVE PJtOBt.t VIS t\ SC AllMi 

To some it may appear that randomisation and scaling would consider¬ 
ably increase the work load of examining bodies and delay the publication ol 
results. In reality it is not so. A .set of random roll numbers can be prepar¬ 
ed much ahead of examination time. For the examining bodies which havi 
an access to electronic computers scaling would involve no extra time in llu- 
tabulation of results. Where such facilities are not available some scaleis 
are to be appointed. Since the population parameter of the preceding yeai 
is to be taken as the best Cilimale of the required population parameter, 
the scalers need not wait till all the mark sheets have arrived. If the popula¬ 
tion parameter is known the decision whether a p-arli ular mark sheet would 
require any scaling or not would hardly take a minute. Most mark sheets, 
as we have already di.scus.scd under '-What batches need scaling'.’’" VVoiikl 
not require any scaling. The .scalers would pass on such markshccts 1 »' 
the tabulators with a stamp "No scaling’" while the tabulators would be 
busy with the already passed on mark sheets, the scalers would scale the 
remaining ones. In this manner tabulation and .scaling would go simulta¬ 
neously. We, in the Gauhati university employ randomisation and median 
tcaling by appointing some scalers. It has always been possible for us m 
publish the results within the scheduled time. 

Before concluding this paper vve would like to repteat that “Scaling " 
is the single most important reform that will make our examination marks 
much more dependable than what they are today. This is a reform which has 
been tried in many countries and invariably found worthy of trust. This 
is a reform which neither needs a vigorous training of anyone, nor a radical 
change in the present system. All that this needs is a decision -a decision 
to make a break-through. 
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Scajng o: examination 
Results 

A, B. L.SRIVASTAMA 


The examination majiks are poor estimates of a student’s ability and there 
IS a good deal of arbitrariness and error of judgement in assigning students 
to different ability levels on the basis of the examination marks in any sub¬ 
ject. The problem is whether any improsement in the situation can be 
elfccted by modifying the examination procedure and by evolving statistical 
procedures of estimating true ability of students wiih the help of their exami¬ 
nation markv 

(ONCEPT or TKIT SCORES 

When we talk of assigning a student to liis right place on an ability 
scale, we mean that there is an unknown true score of the student on the scale 
which the examiner intends to estimate, but which can never be determined 
exactly in practice. Theoretically to determine this score, we have first to 
identify a uniterse of items relevant to the given ability. The true ability 
score then would be the axerage of scores that he would obtain on a very 
large number of tests of equal length each of which is formed by randomly 
Sampling items of the given universe. Two pre-conditions are that the stu¬ 
dent himself does not change in this process of lest taking, and on each test 
he is examined by a perfect judge. If the items are objectively assessable, 
such as multiple-choice type of items, any examiner would be a perfect judge, 
but otherwise examiner to examiner variation is introduced, and to arrive 
close to the true score, first the average of scores on each test given by a large 
number of examiners is to be calculated, and then the mean of all these 
averages for the different tests has to be found. 

In an examination, however, the emphasis is not on knowing the abso¬ 
lute position of a candidate on an ability scale, but only the relative position 
which helps in judging one candidate in comparison to another. It is enough 



if the test can give an idea of the relative true distance between two candi¬ 
dates on the ability coutinuuiTi. However, while conceptually the under¬ 
lying ability can be assunred to have a fixed distribution, the distribution 
of true scores depends on the difficulty level of tests being used. Of course, 
the ability score and true score have a perfect corvilinear relationship. 
For obvious reasons, in an examination we are concerned with eslimalion 
of true scores and not of absolute ability scores. 

nSTlMATES OF TRUE SCORES 

The score obtained by a candidate in an c.xamination is a poor estimate 
of his true score and it is possible to arrive at a better estimate of the true 
score by taking into consideration ihe mean and variance of scores of all the 
e.xaminees and the variance of item mean.s or "difficulties". 

For a test or a question paper where items arc of objective type and for 
which scores can be either 0 or 1. Lord (1959) derived a least squares esti¬ 
mate of the true score of an examinee by assuming the model of 'matrix 
sampling". This assumption simply means that the candidates taking the 
test and also the items of the l si are randomly selected from given uni¬ 
verses of candidates and items respectivelv. The estimate is expressible in 
terms of the examinee's actual score, the mean score of all the examinees 
and a certain leliability coefficient of the test. 

PROBLEMS OF SAMPLINCi 

Let us consider the problems of sampling of examinees, items for the 
test and examiners in the context of estimation of true scores in some more 
detail. 

Increasing attention has,recently been paid to sampling aspects in prob¬ 
lems of testing and estimation of error in measurement (Das. 1967). .As¬ 
sumptions of random sampling of candidates and of items (matrix sampliiigl 
have been helpful in developing statistical formulae for esiimaiiiig true sem¬ 
es. but the problem is that these assumpiioirs do not hold good in our com¬ 
mon examination situations. Can we modify question papers so that the 
model of random sampling of items is applicable? If not. what would be 
the suitable procedure for estimating the examinees, true score, which in 
turn would help in more accurate scaling of results'; 

So far as the sampling of examinees is concerned, the problem does not 
arise, as in almost every case, the entire population of eligible candidates 
takes the examination. Of course in achievement surveys and sialisiical 
investigations on effectiveness of public examinations, such as the ones con¬ 
ducted by Gayen et al (e.g. 1961. 1963, 1967), the problem of sampling exa¬ 
minees becomes important. In such cases only with a probability sample 
of examinees, the estimates of various quantifiable characteri.stics of the 
questions and the question-paper are possible to obtain with known margins 
of error. 

For sampling of Hems or questions for the question-paper the universe 
consists of all the conceivable questions on topics prescribed in the syllabus. 
The citoicc of items depends largely on the preferences and biases of paper- 
seters rather than any probability sampling procedure. 

An interesting possibility that suggests itself from the practical point 
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of view, is this. Instead of following the existing practice of paper setting, 
the examination unit may build up a large pool of questions for each paper 
on different sub-topics and in a given year, the paper may be set by selecting 
questions at random from the pools of questions on these topics. This would 
amount to stratified sampling of items for a given paper. The need for mode¬ 
ration of paper will, however, remain to see to it that the paper is well-balan¬ 
ced. New questions may be added to the pools every year and certain 
questions which are found to be lacking in some aspect on the basis of stu¬ 
dents’ responses may even be dropped from the pool. By continuous try¬ 
ing out of the questions it would be possible to build up a pool of questions 
which are more or less of equal diillculty value and require equal time for 
being answered properly. Except in the areas where numerical questions 
arc set. the pool would be of manageable size. For numerical que.stion the 
pools may consist of only types of questions The paper-setters w'ill be assign¬ 
ed the more challenging task of contributing new items for each paper and for 
ihis they need not be given only one or two weeks time as is done at present 
but a much longer time. The pool .should be available to a paper-setter 
when he is asked to contribute new items. Also he may he asked to suggest 
improvements m the items already in the pool. Also the need for maintain¬ 
ing strict Lodlidenliality would become much less. The problem of com¬ 
parability of standards of que>tion-paper from year to year would also be 
to a great extent resolved, as the papers of different years would be 
statistically equivalent. 

It will, of course, he better to have question paper with a large 
number of small questions, admitting of short answers, so that a large 
degree of equivalence between question-papers of different years is 
achieved. 

It is .suggested that the item statistics (difficulty values and discriminating 
powers) arc calculated for every question each year. This is something which 
a Research Cell or L nii can ca.sily do. These statistics will help in deciding 
which questions are good I'or future u.sc and which should he thrown out of 
the pool or rciaincd after modification. 

This IS not a very difficult proposition, because even at present in most 
'ubjecls all possible questions that have been asked over a number of years 
can be readily idcniilietl. In fact, the whole syllabus can be spelled out in 
icrms of qiic.-iiions that are or can be .set in examinations. Sampling ,ques- 
lons is then a simple task. However, from pedagogical view point, no one 
would perhaps support the idea of spelling out the syllabus in terms of ques¬ 
tions for examination. Moreover, this would restrict the scope for construct¬ 
ing new. thought-provoking item.s. Therefore, the need for replenishing the 
pool of items from time to time remains, even if the suggestion for setting 
question-papers by sampling is accepted. 

Now let us examine the problem of sampling examiners. As has been 
pointed out above, in objective type of tests, there is no scope whatsoever 
for inter-examiner variability in scoring. However, if for practical or peda¬ 
gogical reasons, essay or short answer type of questions are considered 
necessary in a question-paper, v ariaiion is found to occur in the marks assign¬ 
ed to a given examinee on the same questions between different examiners. 
A statistical solution would be to have each examinee's answer-book examin¬ 
ed by several examiners and a mean of the scores assigned by them taken 
as a score of that examinee. .Also a least squares estimate of his true 
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score could be worjced out as has been suggested in the previous section. 
If the budget would permit, from a pool of examiners, several samples of 8 or 
10 examiners could be randomly selected to examine different sets of answer- 
boolcs. At worst, there must be at least two examiners for each answer-book. 
But even this is generally not possible in practice. Therefore, some other 
solution must be found to take care of inter-examiner variability in public 
examinations and we shall discuss this in the next section. 

It may, however, be recognised that the statistical formulae for esti¬ 
mating true scores are applicable only when random sampling of examinees, 
items and examiners talKs place. If the formulae are applied to scores 
obtained in question-papers as are set at present, one will have to assume 
that questions of the paper constitute a random sample from a hypothetical 
universe of questions. This is, generally speaking, not a sound assumption. 

Statistical formulae on the other hand, also need to be developed to 
estimate true scores for many new situations. When all the three elements 
viz. examinees, items and examiners are being sampled, the formulae should 
be based on a three-dimensional matrix sampling. Also, when examinees 
are allowed choice of questions, when the questions carry different mark.s 
and when the paper consists of questions of different types, the statistical 
procedures of estimating true scores would become exceedingly complex, 
and quite a bit of research would be needed to develop appropriate formulae 
for the purpose. 

SOME practical suggestion.s 

In the procedures requiring statistical estimation of true scores for the 
purpose of scaling the results, several limitations ha\e been noted. The.se 
may be summarised briefly as follows ; 

(1) Assumptions of random sampling are difficult to fulfil in respect 
of items and examiners; 

(2) Appropriate statistical formulae may not be available for dif¬ 
ferent types of question-papers; 

(3) Even when other conditions are fulfilled the formulae will give the 
required estimates only when all the data (item-wise scores of all 
the examinees) are analysed. 

The last difficulty mentioned above is experienced even when scaling 
is attempted to bring the marks awarded by different examiners at par by 
equating them in respect of mean and standard deviation as suggested by 
Taylor (1963). The adjusted marks of students can be determined only 
after the marks are received from all the examiners and means and standard 
deviations are calculated for each set. 

In addition to these difficulties there is also another point to be noted. 
Assuming the conditions of matrix sampling are satisfied the margin of 
error in the estimates of true scores may be fairly large especially when very 
few questions constitute the paper and inter-examiner reliabili .y is low. The 
error is large when the test reliability is low, as it becomes a product of the 
content reliability of the test and the correlation between marks assigned 
by two examiners (Harper, 1963). 

When the margin of error in estimation is large, one thing becomes 
obvious. Instead of assigning scores to the examinees, they may be grouped 
in a few broad categories, so that no undue importance is attached to scores 
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(or even estimates of true scores) of the individual students, which are so 
fallible indices of their real ability. The results may then be in terms of 
letter grades A, B, C, etc. This is not to suggest that the examiners should 
assign letter grades to the examinees, for then the chances of error will be 
large. The examiners should give numerical scores as they do at present, 
which may be converted later into letter grades when results are announced. 
However, the inter-examiner variability in award of numerical scores can 
be reduced if questions are of short answer type and many, and model 
answers, are provided to examiners. Detailed instructions on how marking 
should be done will help in achieving a greater uniformity among examiners. 
Also there is a need to publicise how different marks are awarded on diffe¬ 
rent types of answers to the same question. This will help the candidates 
also in avoiding certain pitfalls in answering questions. They often have the 
knowledge but cannot write answers which are concise and to the point. 

For scaling the marks of different examiners, a very useful suggestion 
on use of letter grades has been made by Dandekar (1968). He has suggested 
that first the answer-books may be rendomly assigned to examiners to be 
marked in the usual way. Then the answer books marked by each examiner 
may be ranked in decreasing order of marks from highest to lowest. Next, 
letter grades may be assigned to each examinee on the basis of whether he 
is among the top l“u, or the next 4‘’„ group or in some other such group. 
It may be decided in advance what percentage range would constitute diffe¬ 
rent groups and which letter grades should correspond to them. In this 
process of deciding the grades of candidates, the practical difficulties in 
.scaling of marks by equating means and standard deviations of different 
examiners are not encountered. Apart from the practical difficulties the 
distribution of marks awarded by two examiners may differ not only in res¬ 
pect of mean and standard deviation, but also shape parameters (e.,g. skewness 
and kurtosis). The procedure suggested by Dandekar statistically resolves 
this problem also. Finally, the letter grades in different subjects may be 
combined to arrive at an over-all letter grade. This may be done by using 
suitable statistical procedure (such as of normalisation) for assigning nume¬ 
rical values to each letter grade and then determining the total or average 
of these to be reconverted into an over-all letter grade. The main argument 
in favour of declaring the results by broad categories of letter grades is that 
the numerical marks assigned to candidates are very fallible having a fairly 
large margin of error. But if the letter grades are based on numerical 
scores, there will always be a greater chance of misclassification for border 
line scores. For example, if students get scores above 90 and 4“o get 
between 80 and 89 and the letter grades for these two groups are AI and 
A2 respectively, then a student scoring 89 or 90 is more likely to be mis- 
classified than a student scoring 95 or 84. For the students scoring marks 
which are close to the marks that separate two adjacent categories, the ideal 
solution for assigning then to one of the two categories with greater accuracy 
would be to give them a new test for finer discrimination. This is rather 
a difficult proposition for practical reasons. To reduce the serious impli¬ 
cations of misclassification, it would be desirable that the categories or letter 
grades are not v ry few. They should not be less than 5. Of course, at the 
crucial dividing points such as those which d.termine ‘pass’ and ‘fail’, it 
would be quite desirable if for the students in a certain range of marks near 
the dividing point either a new examination is arranged, or failing that, their 
answer-books are re-examined by two or more examiners so that their 



actual position is more accurately determined. Also grace-marking based 
on standard errors of measurement provides some safeguards to students 
from being unjustly failed. 

SUMMARY AND CONCLUSIONS 

An accurate scaling of results is possible only when the scores in an 
examination are perfectly reliable. As that is an impossibility, one can 
only try to arrive at the best estimate of a candidate's true score by statis¬ 
tical procedures. These procedures arc valid only when certain conditions 
about sampling of items, examinees and examiners are satisfied. 

The possible improvements in scaling and estimation of true scores 
have two aspects : 

(1) improving the conditions w'hich are needed for validity of statis¬ 
tical procedures; 

(2) de-recognising the importance attached to numer'cal scores. 

For (1). there is a need for modification in paper-setting procedures 
fby introducing a system of .setting papers by random selection of items 
from a pool) and for assigning amswer-books at random to examiners for 
evaluation. For (2). the practice of assigning letter-grades to students 
inst ad of numerical scores needs to be adopted. Scaling of the marks of 
different examiners can be carried out by adopting a procedure of ranking 
and assigning letter-grades, as described by Dandekar (1968). 

These suggestions if followed are expected to bring about considerable 
improvement in the accuracy of examination results. Some ideas have al¬ 
ready been tried in some places like Gauhati. Actually there is need for more 
and more experimentation in this area and for shedding of the rigidity and 
conservatism responsible for adherence to existing examination practices 
in the Boards and Universities. 
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3orc.erjne Cases in 
Examination 

V.S. MISRA 


IMROUlCTION 

To PASS AN' examination some minimum mark is lixed in every paper. 
This implies that every paper represents somewhat different task and a mini¬ 
mum achievement in each is necessary. After marks are tabulated, many 
eases are discovered who have otherwise done well but failed in one or 
two papers by a narrow margin. We are hesitant to fail such cases because 
we know that our examinations are fallible, we feel that it is just probable 
that a candidate missed the minimum in one or two papers due to the fallacy 
of the examination and we do not want that a candidate should fail the 
examination not for his fault but for the fault of the exmination. Some 
candidates who under the prescribed rules would have faild. are therefore 
allowed to pass often by giving grace marks. The rules for the “grace 
marks" remain at best arbitrary. Thus a question arises: can we find some 
scientific method to deal with the brderline cases? What follows is mainly 
based on the work done by our Unit, and Harper and Misra (1970). 

COMPONENTS OF OBSERVED MARK 

The components of the observed mark of a student are; true mark, 
constant error, and random error. By true mark is meant the mark which 
the student should rightly get. Constant errors are those where an examiner 
gives students constantly higher or lower marks than they actually deserve. 
Constant errors, as the name suggests, remain constant for every individual 
of the group. Hence their magnitude for every candidate can be estimated, 
and their effect can be virtually made negligible by scaling. It has been 
discussed in another paper (Misra, 1971) how to scale marks. For further 
discussion we would therefore assume that constant errors have been 
removed by scaling and it is only the random error that remains in the ob- 



served marks and has to be considered for dealing with the borderline cases. 


NATURE OF RANDOM ERRORS 


Random errors are those which are sometimes positive, sometimes 
negative, sometimes small, and sometimes large. If the amount of random 
errors involved in the observed marks of a student were known, we could 
decid.' who should pass the examination. Unfortunately we cannot know 
this none the less we can estimate the size of random error for a group, 
and hnd out for a candidate the probability of failing in a paper due to such 
error. 


Random errors, as the name indicates, are governed by the law of chance. 
That is, due to random errors the chance of failing in one paper is higher 
than in two papers. To illustrate, if due to random errors the chance of 
failing in one paper is 1 /5, the chance of simultaneously failing in two papers 
is 1/5x1/5=1/25, and in all the papers of a six-paper examination is (1/5)“ 


= ■ This means that there is only one chance out of 15,625 that a 

15,62j 

candidate has failed in all the six papers by random error though his true 
mark is a "pass” in every paper. However, this also means that out of 
15.625 such eases. 15.624 are genuine cases of failure. We have no means 
to find out which particular case in the big lot of 15,625 has failed due to 
random error. We would therefore prefer failing all the 15,625 candidates 
to passing all of them. But if we were to discover that out of 100 cases. 99 
have failed due to random error; we would certainly prefer passing all the 
100 cases to failing all of them. But. then, where to fix the limit between 
the two extremes ? 


SOLUTION 

We know it for certain that if ail the candidates of an examination are 
examined again, in every paper many of tho.se who passed in the first exami¬ 
nation would fail in the second, and many of those who failed in the first 
would pass in the second. This is due to the unreliability of the present 
system of examination and this will continue till our examinations are made 
perfectly reliable. But this is hard to attain. The minimum precaution there¬ 
fore an examining body ought to take is to allow all such candidates to pass 
who have the same chance of passing, if examined again, as the one who has 
just passed the present examination. To illustrate; suppose a minimum 
of 33 marks is fixed to pass a paper, and a candidate C gets 33 marks in 
every paper. C would therefore certainly pass the examination. We can 
estimate for C the chance, i.e. probability of passing fairly if he were examin¬ 
ed again. Then in the interest of justice we should pass all the candidates 
who have the same probability of passing on re-examination as C. To 
find such candidates we have to estimate (i) the size of random errors for 
every paper, (ii) the pass probability for C, to be hereafter called for the 
sake of convenience the “minimum pass probability”, and (iii) the pas.s 
probabilities for the borderline cases. 

SIZE OF RANDOM ERROR 

Studies done in India suggest that average random error for a paper 
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of traditional essay test is of the order of at least 7 marks (out of 100) (see 
Appendix A). 

minimum pass probability 

The minimum pass probability for a paper of traditional essay test 
is .5279 (see Appendix A). To find the minimum pass probability for an 
examination, .5279 has to be multiplied as many times as are the number of 
papers in the examination. For instance, the minimum pass probability 
for a six-paper examination is (.5279j®=2.16% and for a seven-paper 
examination (. 5279)' = 1.14%. 

PASS PROBABILITY FOR A .STUDENT 

The Unit has publi.shed a Table “Examination Passing Probabilities” 
(Appendix D) from where the.se probabilities can be directly read. How 
to read the Table is illustrated below: suppose there are six papers in an 
examination and the minimum marks required in every paper to pass the 
examination are 33. .Suppose also that the observed marks of a student 
are 40, 24, 37, 33, 29, 39. 

S/efl One: Note down the observed marks, the minimum pass marks, 
and the dilfcrcnccs as shown below: 


Ob.servcJ Marks 

40 

24 

37 

33 

29 

39 

Minimum pa.s.v m.irk.s 

33 

33 

33 

33 

33 

33 

Dilfcrenve.s 

+ 7 

-9 

-|■4 

0 

-4 

+6 


S/ep Two: Read the pass probability from the Table as illustrated 
below : 

In the Table the dilfcrcnces are noted in the first row. For reading 
the Table start from the highe.st dilTcrence and then proceed in the des¬ 
cending order of the dilTerencc.s. Our highc.^t difference is -)-7, so we shall 
start from -1-7. The first step is to look in the column marked -|-7 and read 
the first entry in the column. (In our case this is . 85.) The second highest 
difficreii.c i> -16. Hence, next move down to the row marked .85 and 
read the value in the column headed -t 6. (In our case this value is .70.) 
Next, move d.iwn to the row marked 70 and read the value under column 
-1-4. (This is 51 in our case.) Next, move down to the row marked 51 and 
read the value under column 0. (For us this value is 27). Next, move 
to the row marked 27 and read the value under column marked 4. (This 
value is 8.) As soon as an entry less than 10 is reached, it should be multi¬ 
plied by 10 and the calculation carried back to the top. Because our value 
has come to 8, we multiply it by 10 (/.e. 8x 10=80) and see in the row 
marked 80 in the column headed—9. This value is 9. Since we got th'S 
value after multiplication by 10, the actual result should be considered as 9 
divided by 10 (i.c. 9/10= 9"„J or .009. This is just what we get by actual 
calculations in Appendix A. 

The whole procedure looks quite forbidding but in practice it is very 
simple. For calculating pass probabilities we should consider only those 
cases who have secured the minimum marks required on the aggregate but 
failed in a few papers. For those who have not obtained the minimum 
on the aggregate, the pass probabilities will always be lower than the “mini- 
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mum pass probability”. Hence there is no need for reading pass probabilities 
for such cases. Further, Step One may very well be done in mind rather 
than on a separate sheet of paper and for Step Two we need not calculate 
the probabilities for all the differences. The probabilities become smaller 
for the succeeding difference; so as soon as the observed probability for a 
candidate becomes lower than the “minimum pass probability” fixed for 
the examination, one should stop further reading of the Table. Our ex¬ 
perience shows that one adept in handling the Table will hardly take 30 IS 
minutes time to dispose of a batch of 1,000 examinees. 

POSSIBLE EFFECT OF THE APPLICATION OF THIS METHOD 

In the present system of examination the candidates whose true marks 
in every paper are just on the pass line or slightly above it are most likely 
to fail the examination because due to the very nature of random errors, 
their achievement will most probably be under-rated in a few papers. How¬ 
ever, those students whose true marks are just below the pass line are most 
unlikely to pass because their achievements have to be over-estimated in 
all the papers to enable them to pass. This has due to the nature of random 
errors negligible probability. Thus the overall effect of accepting marks as 
absolute measures is that the number of pass-deserving candidates who fail 
the examination is much larger than the number of fail-deserving candidates 
who pass the examination. If we employ the proposed procedure dealing 
with the borderline cases, more students will pass and probably these would 
be the ones who ought to pass the examination. 

DISCUSSION 

It may be observed that if all the papers are supposed to be measured 
of the same ability, then the aggregate marks of a student rather than his 
marks in individual papers are more dependable. However, so long as 
we insist on a minimum achievement in each paper, the present approach 
seems highly valid for dealing with the borderline cases. 

It may be emphasised that the proposed method is not based on any 
compassionate grounds, as is usually the case with the award of grace marks. 
In this method, only those students are allowed to pa.ss who on re-examination 
stand the same chances of passing as the candidate who^e observed marks 
are just the “Pass Mark” in every paper. 

references 

Harper, A. E., Jr., & Misra, V. S. Research on Examination in Mia. Unpublished 
MSS, 1970. 

Misra, V. S- Scaling of Examination Marks. Paper read in the Seminar on Examination 
conducted by the lUB at Delhi in 1971. 

Pearson, E. S.& Hartley, H. O. (ed.) Biomeirika Tables for Statisticians, Vol. I. Cam¬ 
bridge University Press, 1962. 


160 



APPENDIX A 


estimate of random errors 

In ihe present context we want to know the magnitude of the differences between the 
scores of students if they are examined again using a parallel test. The standard error 
of such differences is called the “standard error of substitution”. A practical method 
for estimating standard error of substitution is to administer two parallel tests (say A& 
D) to the same group of students after an interval of say 7—10 days andgeteach set of 
scripts independently examined by two competent examiners (say examiners X & Y for 
lest A, and examiners P<1 Q for test B). The mean intercorrelation between the scores 
of examiners of parallel tests (i.e. the mean of r XP, r XQ, r YP, and r YQ) may be 
considered as the best estimate of the reliability of each parallel test. Note, for taking 
mean of the r's, convert the r’s to z’s, take mean of the z's and then convert the mean z 
tor. The formula for converting r to z is: 

z—1/2 [loge (l+r)—loge(l—r)] (Transformation of r into Fisher's z) (1) 

However, in most cases the conversion can be made by the use of standard tables. The 
mean of the four variances U e. the variances of the marks of examiners, X, Y, P, and 
Q) may be considered as the best estimate of variance of each parallel test. The stan¬ 
dard error of substitution is given by the formula: 

SLS—Sx.^2(l_r Xgxh) (Standard error or substitution) (2) 

Where S.E.S. is the standard error of substitution, sx is the standard deviation of 
the scores (in our case it is the square root of the mean variance of the four markings), 
and rxgxh is the reliability of the test (in our case it is the mean intercorrelation of 
the four examiners of parallel tests). 

The prc.sent author is not aware of any Indian study which satisfies the conditions 
for the estimate of the standard error of substitution nor has he come across any study 
where the standard errors of substitution for traditional essay examinations are re¬ 
ported. A few studies done by the present author have shown the following figures for 
class X standard: 


Paper 

S.E.S. 

(out of 100 marks) 

N 

English (Prose & Poetry) 

11 04 

129 

Geography 

12 08 

98 

History 

8 23 

45 

Mathemalics 

13 35 

119 


•Parallel tests are such where it does not matter whichever test results are used. That 
is both the tests are built by the same procedure and to the same specifications, both are 
examined by equally competent examiners and the raw marks on both are scaled to 
the same mean and dispersion. 

In History the sample size was small (N—45). Every statistician knows that standard 
deviation tends to be smaller for smaller samples. The reason is that the extreme cases 
on which the magnitude of standard deviation mainly depends are most likely to be left 
out in small sampling. Since the S.E.S. is directly dependent upon sample standard 
deviation, the value of the S.E.S. for a small sample is likely to be small. This is a 
probable reason for the small size of the S.E.S. in History. 

It is obvious that for many papers we do not know the values of the S.E.S. Even the 
Values reported above need to be verified by further research. It is suggested that every 
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university should carry independent research to estimate the values of the S.E.S. for 
Various papers of an examination. However, in the meantime it seems reasonable to 
assume that the value of S.E.S. is at least of the order of 7 marks (out of 100) in every 
paper. 


APPENDIX B 

ESTIMATE OF MINIMUM PASS PROBADILITY 

The following procedure is described for those who want to know how the minimum 
pass probability is to be calculated: 

Step One'. Find out the normal deviates for all the papers of the examination. The 
formulafor the estimate of the norma deviate is: 

Normal deviate = X — X ( 3 ) 

S.b.S~ 

Where X is the observed marks of the candidate who just passes a paper (as already 
stated on page 2, we have taken this value to be 33 marks). 

X is the minimum mark expected to pass a paper in the parallel examination (this will 
be 32-5 in the present cases*), and 

S.E.S. is the estimate of the standard error of substitution (this, as already explained 
in Appendix A, is 7 in our casci. 

Inserting 33 for X. 32 5 for, X and 7 for S.F.S. in formula (3) (i.r.. 33 --32 -5) 

■—y-y - 

We get the normal deviate equal to + 07. 

Step Two: Find the proporlron or the area lying under normal disiribuiion for the 
normal deviate obtained in step one. This can be read in any standard table. Iliunielrii.a 
Tables far Slatisiicinii':. fjlu/ne 1 (p. 104) .shows this to be 5279032, say 5279, 
for a normal dcviic of -f 07. In our ca.se this is “the minimum p.iss probability" for 
one paper. 

Step Three: Multiply the '‘minimum pass probabilities" for all the p.np.-rs of (he exa¬ 
mination. In our case 5279 has been found as the “niinimum pass probahilily" for 
cv;ry paper. (This is because we have assumed the S.E.S. to be the same for all the papci s 
If the S.E.S.’s are different for dilfercnt papers, the “minimum pass probability" will dillci 
from one paper to anotherl. Thus for the six-paper examinalion the "minimum pass pro 
bablity” will be ( ■ 5279) ( 5279) ( 5279) ( 5279) ( 5279) ( 5279)— 02164 or 2 164';;,. 

*We take 32 5 and not 33 0 as the minimum marks required to pass a paper in llit 
parallel examination. The reason is that 32-5 is the lower bound of 33 marks. That is 
if a student gets at least 32 5 marks in a paper of the parallel examination his observe! 
marks without exception will be rounded to 33 marks and he will pass the paper. 

APPENDIX C 

ESTIMATE OF THE PASS PROBADILITY FOR A CANDIDATE 

It has already been stated in the paper that the easiest way to find the pass probabilit; 
of a candidate is to use the Table published by the Unit. However, for those who want ti 
know how the pass probability is actually calculated the following procedure is des 
cribed: 

Step One-. Write the observed marks of the candidate, the lower bound of the mini 
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(why we take the lower bound of the minimum pass mark rather than the 
minimum pass mark itself has been explained in the footnote of the Appenix B) and the 
differences between the two as shown below: 


Paper 

I 

11 

III 

IV 

V 

VI 

Observed Marks 
Lower bound of the 

40 

24 

37 

33 

29 

39 

minimum pass marks 

32 5 

32 5 

32 5 

32-5 

32 5 

32 S 

Differences 

+7 5 

—8 5 

+4 5 

+ 0 5 

—3 5 

+ 6-5 


Step Two\ D.vidc the observed difference for each paper by the S.E.S.for that paper. 
This gives the normal deviate. To illustrate, for Paper 1 the observed difference is +7 5 
andthcS-E.S. is 7 0 (Note, we have taken 7 0 marks as the S.E.S. for every paper.) The 

normal deviate is therefore ^ ^ = + l 07x' 

The normal deviates for other differences may be calculated in the same way. The 
results are given in the first row below. Next, read the area lying under the normal distri¬ 
bution for each normal detiale from any standard table. These arc noted in second row 
below. 


Paper 

I 

li 

111 

IV 

V 

VI 

Normal deviate 

+ 1 07x 

—1 21x 

-fO 64x 

-fO 07x 

—0 so 

-fO 93 

Area under the 
normal distribution 

86 

11 

74 

■53 

•31 

82 


Step Three-. Multiply all the probabilities found in the third row above. That is, 
( 8fi),(ll)( 74I( 33) ( 31)( 82)=0 009431. This is approximately 009. Note, sve 
got the same figure for this case (P. 3 from the Table “Examination Passing Probability"). 
This probability is lower than the minimum required for our purpose, so the candidate 
should fail. 
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Gracing 

R. SRINIVASAN 


We will have to concede that the external examinations will have to be 
kept for a long time especially when most of the universities are of the 
affiliating type and numerous colleges of widely varying standards go to 
constitute the universities. The problem, therefore, is to think of ways and 
means of holding external examinations in such a way that their adverse 
effect can be reduced considerably. Though we may agree that the measure¬ 
ment of final competence at the end of the year is the most crucial one, 
objections to dependence on such evaluations only can be raised by pointing 
out that: 

{Q it is impossible to appraise certain types of competence within 
the limits of the scheduled examinations; 

(h) the sample of behaviour which is obtained in the examination 
of a short period is small and the reliability of the appraisal will 
be consequently restricted. In arriving at a proper assessment 
both quantity and quality of evidence must be assured if the reli¬ 
ability of measurement is to be maximum; 

{Hi) a sample which is limited in time may also do injustice to some 
individuals. Performance in a particular day and at a given time 
may fail to represent the usual level of their ability. To place 
exclusive emphasis upon evaluation at a single point in time may 
be harmful: 

(iv) performance under stress or examination pressure may fail to 
represent the individual competence under more relaxed and 
normal life cltaditions, stress varying from person to person; and 

(v) the final tciminal ex ination may also produce unwholesome 
practices in teaching and learning activities in class rooms. 

It is therefore necessary to examine whether it will be worthwhile to 
have more than one terminal evaluation for a proper appraisal of students’ 



achievements. Though coitlinuous evaluation will be highly effective it may 
not be practicable when centralised examinations are in vogue. 

Another approach would be to bring about improvements to the eva¬ 
luation methods. In education the main concern is the human being and we 
continuously seek valid and reliable information about individuals, groups 
and samples of persons so that sound decisions about them can be made. 
The assumption is that the more we know about a person and the more 
accurate the appraisal is, the more likely we will arrive at a sound decision 
about the person. To know a person means to be able to describe him 
accurately, objectively and fully and for this certain attributes for descrip¬ 
tion have to be chosen relevantly. The more precise and quantitative the 
data are the more we are in the right track. The major steps in evaluation 
therefore will have to be: 

1. identification and definition of attributes or characteristics involved; 

2. development of certain operations by which the characteristics 
are made to manifest themselves; and 

3. establishment of a set of procedures or categories for translating 
observations into quantities. 

The qualities with which education is concerned can be measured only 
when some precise definitions are made and units of qualification of such 
characteristics are provided. Strictly speaking selection of equivalent 
tasks and consequently establishment of uniform units in educational testing 
are difficult to achieve. At best a measurement can only provide infor¬ 
mation (varying in degrees of accuracy) and not judgments. Experience, 
training and insight are required to majee conclusions based on the infor¬ 
mation provided by the test in the form of scores or marks. Information 
provided by any measuring device is limited by the nature of the instrument 
itself. We assume by a test that : 

1. it occurs at a specific time and place; 

2. it consists of a set of tasks uniform for each person tested; 

3. it is seen and acted upon as a test situation by the persons who 
take the test; and 

4. as it leaves a permanent record by way of answers on answer- 

sheets or definite products produced, it increases the objectivity 
and reliability, ’ 

Though the essay type of examination suffers from serious defects 
which are well known to educationists much can be done to improve its 
quality. For improvement, the following guidelines are suggested: 

1. Keep the instruction cum test blue print in front while composing 
your questions. The blue print should serve as a masterplan to 
draft the test exercises sufficiently in advance and allow sometime 
to elapse. 

2. A fresh review of the questions will suggest meaningful alterations. 

3. Have the test exercises examined by a few subject specialists. 
Compare your model answers and theirs which are independently 
prepared so that the questions can be changed suitably to gain 
objectivity. 

4. To realise the potential of a good question it is necessary that the 
question is carefully phrased so that it requires the student to 
reveal the kind of abilities which the test is supposed to elicit. 
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best available estimate of competence in the field of instruction. What is 
meant by competence in the field is something a curriculum expert or a group 
of experts must determine. The first step in deciding what should be re¬ 
presented in a mark or grade is to define clearly in terms of student behaviour 
what several objectives of the subject are and what relative emphasis should 
be given to each objective, so as to guarantee proper appraisal : 

(/■) determine the knowledge and skills that constitute competence 
in that ficld; 

(h) decide what weights should be given to each; 

(///) make clear what types of evidence will be accepted as evidence 
of this competence and determine what effective weights should 
be given to each component and handle the weighting of raw 
scores so that the desired weighting is in fact achieved;and 

(ir) work out a negotiated agreement on a statistical meaning of the 
grading symbols in terms of percentiles or standard deviation 
scores of a defined group. It is normal to adopt a five point 
scale in grading on a statistical basis. When the distribution is 
defined we can assign; 


Symbol A= 

-T-l. 

5 

lo 

-1-2.5 SD 

and above 

7% 

B = 

-fO. 

5 

to 

+ 1.5 


24% 

„ c= 

-0. 

5 

to 

0.5 


38'!'q 

D = 

-1 

.5 

lo 

-0.5 


24% 

E = 

-2. 

5 

to 

— 1.5 or 

below 

7% 


As the number of di.scriniinnlion points increases beyond a certain 
number, the number of borderline decisions increases correspondingly. 
There is increased frequenev of potential error or unfairness in grading for 
dccrcn.sed .'ir.c of error. The accuracy of grading will depend upon the 
reliability of the evidence. The fin d grade will certainly have an appreciable 
standard error of mcas'irernenl. If tlii.s error is large, relative to the unit 
in which the marks or grades are reported, many of the discriminations 
that are reported may be without substance or meaning. 

.Say if a college reports marks in a percentage .system and presumes 
that for a particular .subject the marks have a mean of eighty live a standard 
deviation of 7 a range from 53 to 90 and reliability of .80. The standard 
error will be 7x-\/l ~ • ^0=3-1- So a person’s score will differ from his 
hypothetical true score by 3 points in one third of the cases. So there will 
not be any usefulness if we carry discriminations to a level of fineness when 
most of the scores will be in error. 

Even a well developed essay test cannot be a substitute for an objective 
type of testing. The word ‘objective’ refers to the scoring of answers and 
the choice of content and coverage of an objective lest is probably as subjec¬ 
tive as choice of these for an essay test. The essential features of an objec¬ 
tive test are: 

(1) the examinee operates within an almost completely structured 
task; 

(2) he selects one of a limited number of alternatives; 

(3) he responds to each of a large sample of items; 
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(4) he receives a score for each answer in accordance with a pre¬ 
determined key; and 

(5) in certain cases he is given a penalty for guessing. 

Since each item is brief, many items can be included and they can be 
spread more evenly over all the topics covered and more representative 
sampling can be obtained. This reduces the role of luck. As a consequence 
of the inclusion of a large number of separate items, the score from a well 
constructed objective test is likely to be more accurate, consistent and highly 
reliable than that from an essay test. Since the key is pre-determined in 
advance, bias is removed and scoring becomes mainly clerical and now-a- 
days mechanical devices are introduced to get immediate scores. 

For the development of good items for objective tests adequate training 
and statistical insight are required. It should now become the main task 
of universities to organise evaluation departments with subject specialists 
and statisticians for developing parallel batteries of new type tests at diffe¬ 
rent levels for various courses offered by the universities. Ultimately 
instruction, test item development and appraisal should proceed hand in 
hand and slowly these should become the major responsibility of class room 
teachers. Steps have to be taken to improve the competence of teachers at 
colleges for adopting new evaluation techniques. Experimental work and 
research can be organised in selected colleges and the scheme can be gradually 
extended to cover all the institutions coming under the university. A 
central coordinating testing department can be constituted for constantly 
improving, evaluating and regulating evaluation both internally and ex¬ 
ternally. 
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Post Evaluation Tods 

V.S. MUTHURANGAM 


COLLATION AND TABULATION 

Few preliminary suggestions ; 

1. Senior teachers do not come forward to do the tabulation work which 
requires experience and men of integrity. Some senior teachers, who 
come forward, find it difficult and embarrassing to do the work with their 
junior teachers. The work is laborious and unremunerative for the 
work and time speni by them. To attract good and efficient teachers 
who can do the work smoothly and in quick time, remuneration should 
be increased. 

2. The University Grants Commission or the Government of India should 
provide financial aid to the universities for the purchase of calculating 
machines for the use of the tabulators. 

3. Financial aid should be given by the University Grants Commission 
or the Government of India for the appointment of qualified statisti¬ 
cian to assist the tabulators. 

4. The results moderated by the chief examiner of the subject/paper con¬ 
cerned, the board of examiners concerned and the results committee 
should not be revised. 

For the above purpose, the university should prepare a time-table 

which should be adhered to ; 

(a) The total number of the scripts to be allotted to examiners should 
be decided. This should be done immediately after the prepa¬ 
ration of the name lists of the candidates appearing at the univer¬ 
sity examinations, i.e., a week before the date of commencement 
of the examinations. Not more than 200 scripts for 7 days should 
be given to each valuer. 

(b) The chief examiner should be asked to give a scheme of valuation 
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subject, if any, the minimum aggregate, required the marks for 
the award of division, the rule for conditional promotion, the 
rule for saving of subjects, for the guidance of the tabulators 
for striking the results correctly. 

(f) The tabulators should be asked to be present in the examination 
branch 26 days after the date of commencement of the exami¬ 
nation to start the tabulation of the results as moderated by the 
boards of examiners of the subjects concerned. Wherever coding 
is done on the aniwer-scripts, de-coding should be done imme¬ 
diately after the submission of the valued answer-scripts, in the 
marks list by the tabulators. 

(g) The teachers, who arc appointed as tabulators, should not reject 
the ojfer of appointment of tabulators and they should think 
that this work is part of their normal duties and that the remu¬ 
neration paid to them is only an honorarium. 

5. The office of the examination branch .should indicate the grace marks, 
if any, given by the boards of examiners, on the cover page of 
each of the markshccts of the examiners, before they are given 
to the tabulators for tabulation of results. 

EXAMINATION CO.MMITrn: AND MODERATION OE R[ SULTS 

To cover marginal cases, adjustment of marks from one subject to 
another, without altering the aggregate marks, subject to an adjustment of 
a maximum of 5 marks is made in any one paper,'subject. 

SUGGESTIONS I OK IMPROS L.'If.NT 

1. In addition to the above provisi.on regarding the grace marks, the 
board of examiners should be given the following powers : 

(a) If a question paper contains any errors in the numerical problems, 
the board should consider and give suitable consideration for all 
the candidates who have altcmpicd ili.at question. 

{h) If a question paper contains any printing error or other omission, 
the board should consider and give necessary consideration. 

(fj If a question paper does not contain sufficient choice, i.e. 50% 
choice, the board should be given the powers to examine the 
answers that could be given by the candidates for the duration of 
the paper and give due consideration. 

(d) If a question paper contains questions W'hich arc outside the 
syllabus, which restricts the choice of the question and if there 
is not even distribution of the questions in the paper over the whole 
course, the board should have powers to give consideration for 
the grace marks. 

(e) If an additional examiner in any paper has not valued properly 
according to the scheme of the valuation of the chief cxaminei 
and the average of the marks awarded by the examiner in any 
paper is very poor, even though the total percentage of passes is 
good, the board should have powers to review the answer-scripts 
and recommend the grace marks. 
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2. At present in the Qsmania University, the results committee as 
constituted by the Ordinance does not have any power except to approve 
the publication of results as recommended by the board of examiners. The 
results committee should be vested with some more powers as follows : 

(a) The results committee should be vested with powers to moderate 
the results of the examination if the examiners and/or the board of 
examiners have not followed the instructions. 

(b) The results committee should be vested with powers to moderate 
the results of the candidates who are on the borderline at the 
examinations, as follows : 

(i) Adjustment of marks (one mark for each subject) equal to 
the number of subjects for the whole examination should be 
given to all such failed candidates who have appeared in all 
the subjects or 5 or more subjects and have secured the re¬ 
quired aggregate, provided the maximum number of marks 
to be adjusted in any one particular subject shall not exceed 
five. The marks reduced from one subject should be added 
to the paper(s) in which the candidate has secured the lowest 
marks. 

(i7) Adjustment of marks to the extent of a total of 5 marks 
should be given in one or two papers to the candidates who 
have appeared in more than two subjects but less than five 
subjects. 

(m) A maximum of five marks should be added by the com¬ 
mittee, if this step helps the candidates— 

1. to improve the division; 

2. to complete the examination; 

3. to get a conditional promotion; 

4. to reduce the number of subjcct(s) for which he has to 
appear again. 

(rv) Wherever there is provision of sessional or class-test marks, 
the marks for the candidates for the re-appearance for a 
second time should be carried over, if the sessional marks are 
beneficial to them or the marks proportional to that obtained 
in the theory examination papers should be awarded. 

N.B.—The aggregate should be inviolable except in the cases 
where it is necessary to alter it to the minimum extent, 
to improve the division or awarding a pass or a pro¬ 
motion or enabling a candidate to save certain subjects, 
(v) In the case of postgraduate examination, where there is no 
minimum for pass in individual subject/paper and where 
there is double valuation, a maximum of five marks could 
be added by the committee to enable a candidate to comple¬ 
tely pass the examination or improve the division. In this 
case, the candidates who have secured the first division or 
second division on their own merit, should be classified 
above the rank of such marginal cases of candidates, recom¬ 
mended by the results committee. 

N.B.—For purposes of the above rules, the subject should be 
taken to mean as either a theory or practical. 
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(c) In the case of the postgraduate examinations, the university 
heads of departments of teaching who are professors of the 
subjects should be associated to get the papers valued early by the 
internal and external examiners and to moderate the results of the 
examination so that the delays in the publication of the results 
can be avoided. 

(d) It is seen that the board in the Osmania University has no powers 
at present to review the scripts of the practical answer-scripts of 
any examination. There has been of late complaints of some 
examiners being partial. The board should be vested with powers 
to review the marks awarded by the practical examiners so that 
such complaints can be examined by the boards. 

(e) There must be uniformity in rules in the moderation of results of 
the examination, so that Che tendency on the part of the candidates 
to appeal or represent and get the results remoderated after the 
publication of results can be avoided. 

publication of results 

In the Osmania University the results are published one week after the 
date of the meeting of the results committee, after tabulation of results, 
incorporating the recommendations of the results committee. The results 
are sent to the Director, Department of Information & Public Relations, 
Government of Andhra Pradesh, Hyderabad, who makes arrangements to 
get them published in all the local dailies. There is always a complaint 
that the results are delayed by the examination branch. 

SUGGESTIONS FOR EXPEDITING THE PUBLICATION OF RESULTS 

1. As suggested elsewhere, a time-table should be prepared for the 
despatch of the answer-scripts to the examiners, the date of issue of the 
scheme of valuation by the chief examiner to all the additional examiners, 
the reduction of the number of scripts to each examiner, the appointment 
of additional chief examiners for review of the valued answer-scripts, the 
return of the valued scripts to the examination branch, the duration of the 
pre-scrutiny, the date of commencement of the tabulation, the date of the 
meeting of the board of examiners, the date of the meeting of the results 
committee, the duration of the preparation of the result-sheets, the mark- 
sheets and this time-table should be followed strictly. The results should be 
published within 45 days from the last day of the theory examination. The 
dates of the practical examinations should be arranged well in advance in 
consultation with the principals of the colleges and completed within 45 
days mentioned above. 

2. In the case of examinations for the master’s degree, each answer- 
book is valued independently by two persons of whom one is an external 
examiner. Where there is a disparity of marks in the award between the 
two independent valuers to the extent of 20 or more, the third valuer is ap¬ 
pointed. Where there is no disparity, the average of the two examiners is 
taken for tabulation. This process of taking the valuation of the two or 
three examiners takes more time and delays the publication of results. There 
should be joint valuation instead of independent valuation to expedite the 
results. In this case the moderation of the results by the boards of examiners 
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can be dispensed with. This will cost the university, as the univcr.-.iiv u-,- 
have to bear the T.A. and D.A-. otherwise, there should be indepund ‘ 
valuers drawn from tlic university ilsell instead of the external examiner 
even thoush ihc paper may be scl by the external. 

3. In some examinations like engineering, technology, cdueat/on, 

the sessional marks from the colleges do not come in lime. Somclimes.ii 

looks as though there is tendency on the part of some institutions to send 
the class test marks/scssional marks after knowing the marks of the iiidisi- 
duals at the theory examinations, which may lead to unhealthy competitions. 
The colleges should adhere to a time-table and send the above marks imme¬ 
diately after the last day of the instruction and in any case before the date 
of issue of the hall-tickets to the candidates for the university examinations. 

4. For some examinations, the submission of dissert-ations/monogra- 
phs/thesis form part of the results. The teaching as.signmcnts in the colleges 
should be so arranged that the candidates arc able to submit the above 
immediately after the last day of the instruction in the colleges. 

5. For some examinations, visit to places like Newspaper OlTiccs, 
Museums, Archaeological Sites, Geological Survey, Industrial Organisations 
arc a must for preparation of project-report and the marks awarded form 
part of the results. In this case al.so, the heads of departments of leaching 
of the university should prepare the timc-schcdulc for all the colleges and 
inform the teacher concerned to arrange to forward the project-reports 
befor: the date of the commencement of examinations, to expedite the 
publication of university examination results. 

6. At the end of the university examinations, the chief superintendents 
of the examination centres should send the complete list of the candidates 
who had appeared at the university examinations, for each day of the exa¬ 
mination, the cases of malpractices, the plan of the examination hall, 

ISSUE OF MARKS SHEETS 

At present, in the Osmania University the marks-shects are being issued 
to each candidate appearing at the university examination, after collecting 
a fee of Rs. 2/- per candidate, alongwith the examination fee. The marks 
memorandum is prepared by the teachers who are remunerated at Rs. 10/- 
for 100 mark’s-sheets. Additional marks-shects -are also issued by the staff 
of the examination branch, on collection of additional fee of Rs. 2/- for each 
marks-sheet for each examination. 

SUGGESTIONS FOR IMPROVEMENT 

1. Till the card system is introduced and till the mechanisation is 
implemented, the compulsory issue of the marks memorandum may be 
continued. The remuneration to the teachers is not attractive and since 
this job does not involve any technical work, the preparation may be en¬ 
trusted to the administrative staff of the office of the registrar, examination 
branch and the other colleges, on the above rate and they be informed that 
they should complete the work of preparation of marks-shects within one 
week from the date of publication of results and despatch to the colleges, 
so that the marks-sheets arc available to the candidates at all the colleges 
on the 10th day of the date of publication of results. Now it is experienced 
that teachers who are appointed as memorandum writers are irregular with 
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the result the memorandum of marks could not be sent in time and there is 
lot of unrest among the candidates who have pnid the fee for the mark'; 
^vith the examination (cc. 

2. In addition to the issue of the marks sheet for each of the exami¬ 
nations to each candidate, a.s above, there should also be provision for the 
preparation of a common marks-sheet of the caiididale if he has not passed 
all the subjects of the examination in one attempt, on collection of extra fee. 
This would help the candidate to seek admission to higher class by sub¬ 
mitting only one mark sheet which would give ihe complete history of the 
candidate’s progress and also help students who would like to seek admission 
in other universities or foreign countries. In the consolidated marks-sheet, 
the appearance of the candidate, indicating the year of his appearance, year 
of passing, roll number of the e.xamination of each of the papers/subjects of 
the examination, his name, his father's name the name> of the college where 
he has studied last or if he is a private candidate, the address of ihe candidate 
can also be indicated. 

rXAMlNATlON HreORDS 

The examination records have to be carefully maintained at the college 
level and at the university level. The printed question papers for each 
examination arc sent 3 days before the date of commencement of the exami¬ 
nations. The stationery is also supplied in advance to each college. It 
is seen in some of the newly affiliated colleges, there is no provision for 
keeping the material safe. The colleges do not maintain proper accounts 
for the stationery .supplied to them. 

At the university level, the following are the categories of the exami¬ 
nation records : 

(i) Application forms received from the candidates alongwith the 
documents, such as the original certificates of the previous exa¬ 
mination, service particulars of the private candidates, the marks- 
sheet of the previous qualifying examination. 

(//■) The name-lists of the candidates of the examination, year-wise, 
semester-wise, session-wise, examination-wise. 

(///) The award-lists of the examiners for each of the papers/subjects 
of each of the examinations. 

(iv) The result-registers from the inception of tiie iini\'ersity. for all 
the cx iminations. 

(v) The li.st of e.xaminers appointed for each .subject paper of eacli of 
the examinations for all the years. There must be a record of 
at least 5 years for this list easily available indicating the names 
of examiners, their addresses, their qualifications, their designa¬ 
tions, their change of addresses, their subject of specialities. 

(vi) The stationery to be supplied to the colleges at each centre for 
each examination. 

(v/7) Valued answer scrirtj to be kept readily available for the use of 
the office for ca-'cs of recounting. 

(I'/n) Used answer scripts to be kept safely for a period of three years, 
before thjy are finally disposed of. 

(;>) Manuscripts of the question papers set by the examiners and 
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stock of the printed question papers before supply to the exami¬ 
nation centres. 

(x) Used question papers of the earlier years for the use of the exami¬ 
ners, as a model, and for the use of the candidates for reference 
and for the use of the heads of departments of teaching, in case 
they desire to make any changes in the scheme of instruction or 
scheme of examination or pattern of question papers. 

SUGGESTIONS FOR IMPROVEMENT 

1. Steel almirahs must be provided to each college for safe custody 
of examination records and for this purpose the University Grants Com¬ 
mission or Government of India may give financial aid to each college. 

2. The filing and indexing system may be introduced for systematic- 
maintenance of records. 

3. The college should be asked to maintain proper accounis of the 
examination stationery supplied to them by the universities. 

4. Of late, it is seen that there is no security to the staff and the records 
of the university, as the students try to enter into the examination branch 
and disturb th"; staff and try to use unfair means. To avoid such tendency, 
full security arrangements should be provided as in the case of banks for the 
examination branch. There must be a liaison officer to hear the difficultie.s 
of the candidates, if any, and to redress them. There must be a recepion 
officer, security officer, and if necessary armed guards to protect the records 
of the university in the examination branch. The University Grunts Coni- 
mission or the Government of India should provide necessary financial aid 
to establish such units. 

5. At present it is seen, that the moderators of the question papers or 
paper-setters do not get the prescribed reference or recommended books 
from the library, whenever it is required. For this purpose, the university 
examination branch should have a small library for maintaining the follow¬ 
ing materials ; 

(a) Syllabi of all the courses and schemes of examinations as approved 
by the academic bodies. 

(b) Recommended or prescribed books (one copy) each for all the 
courses of the examination. When once these books are changed, 
the cancelled books can be sent to the main library of the university 
for the use of the candidates. A library-clerk may be appointed 
for the maintenance of this library. For this purpose, the Uni- 
vesity Grants Commission or the Government of India may give 
financial aid on lines library grant to the university library. 

B. MECHANICAL AIDS 

The change-over from the age-old system to mechanisation will not be 
easy. The officials of the university, clerks, superintendents will have to 
be trained in the operation of these delicate and sophisticated machines. 
No doubt, the machines ensure accuracy, speed and efficiency and will prove 
economical as the number of candidates taking the university examinations 
are increasing year by year. The I.B.M. (International Business Machine) 
can be usefully utilised if the pattern of the examination is changed. The 
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Statistical Institute, Calcutta, will have to be consulted whether they will 
be able to train the officials of the university to operate these machines. 

The machines cannot, in my opinion, be used in the universities with 
the present system of examinations. The method of evaluation has to be 
changed and the marks should be fed into the cards for tabulation of each 
result and for the preparation of the statistics of the results of each exami¬ 
nation. The academic bodies of the universities should be consulted whe¬ 
ther the pattern of examination question papers can be changed into ob¬ 
jective type of questions with multiple choice. 

To begin with, the totalling machines (computor type machines) may 
be provided to the universities by the U.G.C. or Government of India. 
Fuiancial aid should also be given for the appointment of qualified statistical 
assistants in the examination branch at the ratio of 1 for 5,000 candidates, 
to operate the machines and to assist the tabulators for the tabulation work. 

In general, it should be accepted that the examination system depends 
more on the confidence given to the teachers, administrative staff and the 
trust on them to finalise the results, based on the present set of the exami¬ 
nation pattern. In case there is any one, in whom trust is lost or who does 
not discharge his duties with integrity so as to lose the confidence of the so¬ 
ciety or general public, immediately the concerned person should be punish¬ 
ed and should not be given examination work. But, on this count, the 
examination pattern should not be changed, and all the staff should not be 
suspected. 

The Inter-University Board had suggested to introduce the system of 
award of marks by symbols at the university examinations in all the 
universities. 

The difficulty is faced because admission is by marks and we cannot get 
relet ant marks in the symbols. 

So far as llv; Osmania University is concerned, this recommendation 
has not been accepted by the faculties except in the case of the faculty of 
education. Even in the faculty of education, this scheme has not been 
introduced. If this pattern atleast is introduced, the task of tabulation and 
finalisation of results might be somewhat facilitated with the help of some 
set formulas. 
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?ost jva^uation ^o'js 


J.M. MEHTA 


TABULATION 

In most of the universities and examining bodies, the work of preparing the 
results is done by the university stall and'or by tabulator^ appointed by the 
university authorities from amongst the teachers. Ordinarily a period of 
about six to eight weeks is required between an examination and publication 
of its results. This work can be expedited if a larger number of examiners 
and tabulators are appointed. But in doing so there is a danger of sacrificing 
the uniformity of assessment and also of a larger number of mistakes creep¬ 
ing in at various stages of tabulation and in.determining the final resull.s. 
Speed need not be aimed at the cost of accuracy. 

During the process of compilation of results, the administration has 
to be vigilant enough to ensure that no leakage of marks and results take 
place and utmost secrecy is maintained by the staff. (Once the result in a 
subject, i.e., the final marks are submitted by the examiners to the university 
the burden of maintaining secrecy is passed to the university office.) 

MODERATION OF RESULTS 

The practice of moderating the results by an examination committee or 
the faculty or a board of moderators before their publication, prevailing in 
some universities, needs to be dropped as it leaves scope for malpractices, 
favouritism and victimisation. Moderation of the results in the manner 
also delays the publication of the final result. 

It is suggested that instead of moderating the final result of the exami¬ 
nation, it is better to ask the chairman or a group of examiners, if there are a 
number of examiners in a subject, to meet and finalize the result in the subject 
by moderation, if necessary. The marks so arrived at should be entered in 



the final result sheet and the result so prepared be published. This will 
reduce the incidence of leakage of examination results before they are pub¬ 
lished and eliminate some delay in publication of results. 

It is also suggested that a set of rules be framed for automatic condo¬ 
nation, as are framed by the Bombay and other universities in the western 
India, for condoning failures to a certain extent in one or more heads. This 
will serve the purpose of moderation and will leave no scope for undue favour 
or injustice to any candidate. The university authorities need not worry 
about any student agitation—as it is taking place now-a-days—on account 
of low percentage of pass at an examination. 

MECHANISATIO.N 

If a university decide^ to take the .help of machines, it will be necessary 
10 have some technical slaU" lor operating the machines. It will al.so be 
necessary to modify some of its firms and procedures. The entire proce.ss, 
.starting from the form of ypnlication for admission to the examination, to 
the form for tabulation and marking of result, together with the form of 
mark-statements will ha\c to be modified so as to suit the machines. A 
careful programming in respect of each examination will be necessary 
b'^fore computerising the process. If this is done the computer will not only 
prepare the individual results bui will also be able to give statistical schedu¬ 
les and result-sheets which go to the pres.s. 

Mechanisation also enables u.s to prepare individual mark-sheets and 
passing certificates accurttiely and speedily. It is found that the processing 
of results on computers is cheaper than manual processing and it ensure; 
both speed and accuracy along with neatness. 

PUBLICATION OF RESLT-TS 

Usually the results of diJTereiit university examinations are published 
on the dates which are fixed b> ‘.he office in advance and are announced in 
prominent daily news-papers in the Stale or at headquarters. Printed or 
csclostyled official copy of result is supplied to the authorised representative 
of each press and P.T.I. as well as to the authorised representative of an afii- 
liated college in the evening of the day preceding the date of declaration of 
the result on the express written undertaking that they will not be published 
before the schedule lime. The results are normally published on the schedul¬ 
ed date in this manner. This system is found to be quite convenient. 

The affiliated colleges and the public often demand for simultaneous 
publication of results in the colleges and at all centres of examinations. The 
postal difficulties, the college timings and the size and the standard of the 
new's-papers published in motfusil area create more difficulties than give any 
advantage in publication of results. 

PRESERVATION OF RECORDS 

The last but not the least important is the work of keeping a systematic 
and up-to-date record of the different documents and registers connected 
with the examination. 

The following records need special care and should be pi-eserved and 
made available for reference for the period mentioned against each ; 

1. The final copy of the result .sheet (2 copie.s) Permanent 
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2. 

Passing certificates 

Permanent 

3. 

Convocation lists 

Permanent 

4. 

Question papers (some sets, say 6) 

Permanent 

5. 

Mark lists from examiners 

3 years 

6. 

Appointment letters and T.A. and remunera 

- 


tion bills 

5 years 

7. 

Reports of examiners (subject-wise) 

10 years 

8. 

Examiners cards (individual) 

15 years 

9. 

Bills of expenditure at centres 

5 years 

10. 

Statistics of examination results 

Permanent 

11. 

Internal evaluation sheets received from col¬ 



leges 

3 years 

12. 

Cases of malpractices 

10 years 


The old records and other records can be disposed of after obtaining 
necessary administrative approval of the authorities. The aho\'e records 
should be in the custody of a responsible officer and esery lime a record is 
taken out for reference, proper entries in a special register should be made 
to indicate as to when and why a particular document was taken out in order 
to protect infringements of records. 
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Post 3va!.uation .'o js 

S.B. SHAPETl 


COLLATION 

Although the individual examiners are required to exercise the utmost 
care in entering the marks against the numbers of the respective candidates 
and comparing them in detail to ensure correctness, they generally commit 
the following three types of mistakes: 

1- Mistakes in totalling. 

2. Entries of marks against wrong numbers. 

3. Marking absent candidates who have appeared for the examination 
and whose answerbooks they have assessed. 

To ensure absolute correctness in respect of the above four items, my 
university adopted, in 1963. a system whereby all the assessed answer-books 
at the examinations were got checked up question-wise and section-wise, 
as well as the totals, by specially appointed tabulators. The tabulators 
detected more than two thousand mistakes, a few of which were very serious 
ones—for instanec, on the front page of certain answer-books marks had 
been entered against a question which had not even been attempted. Suit¬ 
able disciplinary action was taken against 55 examiners, including a few 
principals and heads of departments in senior colleges. Unfortunately, it 
has not been possible to continue this system as the number of candidates 
taking the e.xaminations has been rising steadily by nearly 20% a year. It 
proved difficult to get an adequate number of teachers to work as tabulators 
when qualified teachers were not available even for assessment, So, the 
number of as,sessed answer-books checked up by the tabulators has since 
been reduced over the years to 10 % of the total number of books assessed. 
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oqi X|ddB iiaqi <aqx 'uoinuapisuoa oiui lanj Sjqi aqni .\aqi 'uoiiEjapoui 
JO aiuii aqi ly XiisjaMun aqi jo aaiiou aqi i'l lauj siqi Siijjq sjoin.iapoiu 
aqi ‘M0| 001 SI iioi)i;iiiiUB\a ub ib siaafqns jo jaajqiis JB|na|).iEd n ui qnsaJ aqi 
JI 'qnaimp X|a,\j)BJBduioa pauiaap aJE qaiq.w ‘ aia sajsXqj ■qsi|Su3 'sajiBiua 
-qiBjq aq’ji si.aafqns iii X|[nj3ads 'sainpipuBa aqijo aaiinuuojjad aqi jo XijiniiD 
aqi 01 SB napi q3ii0J li aAnq 01 uaqciJapun sj Xuiiiuas ’aSuis siqi )V XiaiEip 
-auiuit luaqi .\q papaJJoa ajn qajq.w saqiiisiiu auios laaiap qBaiiaBJd b pun 
Jadnd e jo Jadnd auo iinqi aJoiu qii.A\ spafqns uj sq.iEUi aip SiiiminqBi apqAi 
‘oqAV ‘laafqns qana iii sJoinjapoiu aqi 01 ua.AiS si aauBisjssi; .lasaMOH 
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publication of rksults 

First, ii schedule for dechimtion of results is published iu the papers 
and a circular letter is sent to all the institutions well in advance. On the 
;ippointed dale, at 6.0 a.m.. the results of the examinations are announced 
simultaneously at the universiiy ofFicc. at thccollegc.s and in the newspapers. 
To enable the papers and the institutions to declare the results on the same 
day and at the same time, copies of results arc sent to them two days in ad¬ 
vance. The results arc announced in the Tollowing order: 

(1) First Class. 

(2) Second Cla.ss 

(3) Pass Class. 

The list of candidates vs ho secure the first ten ranks among the success¬ 
ful candidates, is also piiblishetl along with the results at the examinations. 

issfi (It MAUK.s Mil l rs 

The staicincnts of marks arc prepared two days in advance of the dec- 
lai alien of results concerned and they are sent to all the colleges along with 
I be results through members of the olTice staff, so as not to inconvenience the 
students migrating to other universities and applying for jobs or admission 
to higher courses in the institutions of all India status. Although this 
practice involves some expenditure to the i niversity, the student community 
and the public have come to appreciate this arrangement. 

rVAMISATION JILCORUS 

The re.sult sheets of examinations and the office copies of statements 
of marks arc bound and kept in safe custody in charge of superintendents. 
They are not accessible to any person other than the office staff in charge 
of these results, since any laxity in this regard may affect the inviolability 
of the records. But there are a few cases of students tempering with the 
marks in the marks-shects received by them through the colleges, in seeking 
admission to higher course.s. These cases are dealt with severely and punitive 
action taken agaist them. 

VIECHANICAI. AIDS 

The university mechanised examination work in October 1967 by acq¬ 
uiring a tabulator, tw o sorters, a reproducer and other ancillary equipment 
like punching and verifying machines. The required .staff was trained under 
experts. The post-examination work done on the machines saves a lot of 
time but the pre-examination work still lakes as much time as when done 
manually. The machines are also not absolutely loolproof as regards the 
accuracy of the jobs and the sta.T working on the machines have to be very 
alert all tbe time and check up at least 1 in 10 cases. But. on the whole, 
mechanisation of examination work has made far greater economy, effi¬ 
ciency and promptness. 

In the existing circumstances, mechanisation has come to stay. The 
phcnomeiuil increase in the number ol candidates has compelled the univer¬ 
sity to think serioasly of the need to go in for a computer for doing both exa¬ 
mination and rc.scarch work. But this presupposes careful planning and the 
proper training of the staff before putting them on the jobs. 
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:^our 


Auditing & Accounting o: 
Examination Accounts 

K.N. THUSU 


The essential features of scheme of governance of ihc universities laid 
down in their respective charters and in the Statutes framed thereunder have 
generally remained unaltered althoui;h at every level university govcrnnteni 
has tended to become more elaborate as the hierarchy of varied number of 
Committees testifies. No serious attempt has been made to dilTuse the 
over-emphasized centralized decision making to appropriate levels to 
ensure better servicing ofthe authorities including their Committees in the 
absence of which; in effect, responsible and effective sustenance of the 
prime objectives of the universities cannot be expected. 

During the last three five-year plans the development activities in the 
universities have tremendously increased the burden of the non-acadcmic 
staff mainly due to relatively meagre allocations in those plans under thi.s 
head. New diversified inter-disciplinary courses of studies have been added 
with the institution of new departments. Reforms in the system of exami¬ 
nations have been initiated and are being experimented upon. It is 
common ground that in major universities the volume of administra¬ 
tive work connected with conduct of examinations and it.s complexity 
have increased to such an extent in recent years that the present machinery 
is severely strained. At many vital points there is inadequate follow up. 
There is insuffi'icnt emphasis on individual responsibility and on the 
observance of time schedule. Delays in day-to-day business also occur 
frequently with increase in the tempo'of development and in the range of 
administrative responsibilities. These problems have assumed greater 
urgency and, thciefore, demand far-reaching changes in administrative 
structure, procedures and approach. 

Contribution of the administrative units sustained by an effective orga¬ 
nisational system in a university to its prime objects has to play an impor¬ 
tant part in the promotion of these objectives and to the well balanced 



growth of a university. Apart from the well defined administrative pro¬ 
cedures evolved for purposes of effective control it is necessary to have a 
look at thepresent situation with reference to the structural complex and 
the personnel manning the university offices. 

Registrar, a statutory officer, in the present context of the outmoded 
statutory provi-sions, in most of the universities, cannot in his functioning 
delegate such of his functions as are deemed to be statutory functions. Con¬ 
duct of examinations including supervision thereof, being one of the statu¬ 
tory functions, wherever such a provision exists, cannot, therefore, be dele¬ 
gated to any other functionary unless the statute itself is amended in order 
either to incorporate a provision for delegation or to delete the provision 
itself. In such a situation it would be possible for the registrar to attend 
under the eased conditions primarily to the academic administration of the 
university complex. In Delhi Univer'^ity steps have already been initiated 
to amend the statutes (since amended) and holdthe controller of examina¬ 
tions responsible for ihc conduct of examinaijons. It is a step towards 1 he 
light direction especially when the financial administration had ahead) 
been entrusted to a finance offiecr who functions under the vice-chancellor 
pro-vice-chanecllor. In erect the university administration will have" 
three divisional heads each responsible for the sphere of work ur.der his 
charge. 

Assuming that major universities as are required to arrange for c.vami- 
nation of a very large number of examinees possibly over 50.000 would on 
review of their existing structure find it convenient to split the existing admi¬ 
nistrative complex into broad divisions and the controller of examinations 
charged with the responsibilitv of the conduct of examinations, the next 
question which would require serious consideiation would be regarding the 
siructure of ihe sections. In ihi.s context it is worthwhile to comment on the 
present set up which .ccncrallv obtains not onl_v in the universities but else¬ 
where also. Pvramicl like structure of personnel manning the sections, 
clerks at the base, then assistants, senior assistant and with superinten¬ 
dent as the in-charge, tends to obstruct efficiency, conditioned further by 
adhcrJiice to rigid routine procedures vviih no scope for initiative or inno¬ 
vations. In other words the present .system is a veriical structure in which 
any ca^c has to go up through diffcrcni levels. The decision tiiking level 
being at the top of the pyrantid. so that not oiilv does the case take a great 
deal of time to reach that level ihrough other levels behiw but also m.any a 
cases ultimately reach one point for decision. li is here at the base that 
major refoi m is imperative and c-ssential as an aid to the fulfilment of objeci- 
tives in view. 

Day in and day out reciuitineni of raw persons as clerks or as assis¬ 
tants with no training facilitie.s available to them to deal with complex nature 
of work is a contradiction in terms in relation in objectives we have in mind. 
The very purpose of ensuring speedy oU!put with progressive .=ound base is 
dcfeaicci. Delegation of rc.spon,sihiliiy lo lower levels in these circumstances 
cannot be thought of. The result is that there is constant pressure on the 
higher category of stall' not merelv confined to important maitets but with 
an overdose of routine matters. 

The whole structure need not be vertical one but should consist of dif- 
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ferent self-contained units. Each unit should consist of an officer competent 
to take decisions assisted by other supporting staff. The officer can be a 
superintendent or an assistant controller or a deputy controller depending 
on the nature of woik involved in a unit. There can also be other types of 
combinations according to the nature of work. The main point of change 
would be that : 

(a) There should be self-contained complete units headed by officers 
competent to take decisions; and 

(h) within the unit there should be no levels at all since the officer 
concerned would be the only level (to the extent responsibility is 
delegated to him) and the others merely more or less his per¬ 
sonal staff. 

It is inevitable that in a sy.siem ofihis lypethere will be an iiicTcasc m rhe 
niinibcr of officers and a decrease in the clerical staff. There is. however, 
not milch dilfcrence at present between an assistant controller and a superin¬ 
tendent in tlieir experience, equipment or competence. Either can head a 
unit of the same type. 

The phy.sical location of the examination units is also a %cry imponant 
point which has a bearing in this system. The work to he handled being 
mainls confidential and allied in nature it is essential that each unit is located 
in the same place and contains all its own records. It is also essential that 
besides the work rooms for these units adequate provi.sion is made for (i) 
storing of scripts in the manner as would make it possible to refer to these 
scripts (whenever required under the present system) without loss of time. 
(//) storing of printed question papcis and work room attached to it, and 
(m) an adequate number of committee rooms for moderation of question 
papers and results. 

Tt is my belief that such a system is bound to lead to a keen sense of com¬ 
petition and charged with the faith that there is always a better way of do¬ 
ing things and that every impio\emciU i^ only one step towards fuithcr im¬ 
provement. This would also leave us wilh the .scope for simplification of 
work. Since it is visualized that suffi' ienl discretion would be available to 
ihc unit heads in the matter of procedures of r.ouiine it will stimulate 
them with a sense of responsibility ultimately leading to self-critical analysis 
of the work done and thereby fostering a spirit of innovation. 

There should be no objection to (he external audit of the confidential 
transactions to be conducted by a deputy accountant general personally 
and Satisfy himself on behalf of the audit on the followingcondilions : 

(i) The deputy accountant general would do .so in the presence of 
the vice-chancellor or in his absence the pro-viee-chanccllor. 
if any, and the controller of examinations or the registrar, as the 
case may be. 

(ii) The audit will not ask for any information in regard to the sources 
of printing. 

(Hi) The audit will concern itself with the rates of printing duly ap¬ 
proved by the vice-chancellor orders placed for printing of ques¬ 
tion papers and the acquittal of the amount drawn and paid. 
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(iv) In regard to confidential payments made to persons engaged oti 
confidential type of work, the audit will be mainly concerned to 
see and verify whether the amounts paid to such persons had beer 
disbursed after due sanction by the appropriate administrative 
authority and the receipts were obtained for the payments made. 

The e-tamination branch should maintain a subsidiary cash book 
detailing therein, the transactions of the amounts received from the univer¬ 
sity for disbursement as confidential payment. 
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Conduct o: Examinations 
Cey.onees Experience 

M.D G. ABEYRATNE 


University examinations are public examinations even in unitary insti¬ 
tutions where no external students are permitted to appear. So much so 
that in a small country like Ceylon any rejection of a candidate, the non¬ 
receipt of the admission card and’ the time table in time, any prior k"o\\ ledge 
of the questions and any mishap in the examination centre could cause news¬ 
paper head lines in the local press, letters to the editor, editorials and perhaps 
questions asked in Parliament fro.ni the .Minister in charge of Education. 
All these factors contribute in no small measure to make the task of those 
entrusted with the conduct of examinati ons in certain circumstances a niglil- 
niare. 

Universities have undergone considerable changes during the last scvenls 
years and in the democratic system of society we li\e in. they function under 
the full glare of public inquiry and criticism. Unisersitics, by and large, 
are public institutions maintained from the tux payers’ money. The public 
have therefore a right to know and the universities ha\e an obligation to 
ensure, that the examinations, which from the point of view of the candidate 
is a culmination of several years work, arc conducted properly and witlioui 
fear or favour. In this paper it is not intended to discuss the advantages or 
the disadvantages of a particular type of examination. U a.ssumes that what¬ 
ever be the type of examination, the administrator w ill be called upon to con¬ 
duct it. The few point.s that are discussed in this article are for the purpose 
of helping the administrator who is called upon to conduct an examination, 
may be, for thousands of candidates living in various parts of the country. 
These are based on the light of our own experiences and it is hoped that 
the discussions at the seminar will help us to streamline our own system- 

From the point of view of the administrator who has to rely on a large 
number of clerical hands; some with experience, some without, some on the 
permanent cadre of the university and others recruited casually to do a sped- 



Tied job, certain simple practical aids and checks are useful. When an office 
lias to rely on the above mentioned staff and also deal with many hundreds 
of applications within a short period of time and working to a schedule, it is 
necessary to ensure that applications when received in the university office 
are not misplaced or wrongly filed. Our experience in the University of Ceylon, 
Colombo, in adopting different colours for the different faculties and varying 
colours for different examinations within the same faculty has helped us to 
eliminate this problem altogether. Once different colours are used for print¬ 
ing examination entry forms any possible mixing up of application forms of 
the different examinations can also be prevented. 

While the use of different colours prevents delay in the sorting out of 
applications, it is also necessary to ensure that the application form itself is 
not unduly large and cumbersome and that we do not call for information 
that is not immediately relevant to the examination. The checking of eligi¬ 
bility and the typing of schedules can be made easier by confining the data 
the candidate is required to furnish to a single page. It is easier for the 
clerical staff to glance through a single page rather than to wade through 
number of pages containing several columns trying to extract the relevant 
information. Such methods take time and tend to retard efficiency and mis¬ 
takes are bound to occur. The entry form can be drafted so as to confine 
It to a single page of a half sheet of foofscap. 

In Ceylon education is free from the kindergarten to the university. 
Fees are not charged from candidates who are sitting for an examination at 
undergraduate level on the first occasion. Non-citizens, however, are re¬ 
quired to pay tuition and examination fees. Where a candidate sits for 
an examination other than on the first occasion he has to pay the 
prescribed fees. 

Examination fees are not collected by the university office and normally 
chL'quc.t. money orders and postal orders are also not encouraged. The 
insiruclions require the c.indidates to deposit the fees in the name of the 
university at any branch of the Peoples Bank. The university has pros hied 
printed forms to the hank for distribution to its branches. Any person pay¬ 
ing money to the university is required to fill up the paying-in-slip in tripli¬ 
cate. For a receipt to be authentic it must be signed by the Manager ofthe 
bank. One copy of the receipt is sent by the payee with the application 
and the other two copies arc retained by the bank. The bank transmits a 
statement which gives the names of those who have made payment with the 
duplicate copy of the receipt to the Bursar. This enables the Bursar to re¬ 
concile the payments. 

Once the applications have been received it is necessary to determine 
whether those who have applied ive eligible to sit in the e.xamination. The 
question of eligibility can be checked at different points depending on the 
scheme of courses and examinations adopted by a iiiiiversity. This would 
come up firstly at the time of admitting a student to the university. He 
must have fulfilled the admission requirements and passed the competitive 
examination prescribed for admission- The University of Ceylon, Colombo, 
IS particular in selecting its students and the declarations made by them are 
very carefully scrutinised. 

According to the existing rules of our university a student has to sit for 
the first examination at the end of his first academic year in the university. 
This is a qualifying examination. It is an important condition that a student 
who is not successful at the first examination does not continue with his stu- 
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dies and he must leave ihe university. There is provision, however, lo 
readmit him in the event of his passing the examination on a subsequent 
attempl. On the results of the test, those who have pcrforiricd well arc 
permitted to read for a special degree in one subject for 3 years and the others 
are permitted lo read the general degree in three subjects for 2 years. In 
the Faeiiltics of Humanities and Social Sciences this method has been modified 
by doing away with the special degree course and having the linal exami¬ 
nation divideil into two parts. Part I taken at the end of the 2nd year and Pari 
11 at the end of the 3rd ye.ir. Students are also allovseil to major in one 
subject with one or two cognate papers from another subjccl These details 
do not howcscT. obscure the important principle under discussion Ihij 
onl> eligible students apply for an examination. 

Eligibility, in ilic coniiwi of an internai siuiicni is mainly concerned with, 
whether or not he ha.s followed the pre.seribed cotinsc of study meant I'or his 
examination. This matter has been adequately sobed in our uniscrsiiy 
by requiring the heads of departments of '-tiidy lo certify in the .siudents' 
aprlication itself whether .sr not he has followed the prescribed course oi 
study. The ceriilicale of the head of the department is adequate for a stu¬ 
dent to appear for the examination in his subjeel For example, the first 
examination ha.s three subjects and if the three appropriate he.ids iif depart¬ 
ments have not certified the application, the .slnden.i is not eligible to sit. 
His application will be rejected .straightaway. Somelime.s we allow provi¬ 
sional entry to an examination, subjeel to the sUideni satisfying (he eoiirse 
requirements he ha.s failed to satisfy up to the time vd' applying, as specified 
by the head of department. In view of this method .ligibiliiy has been 
adequately dealt with before the application is siibmilieJ to the otVice. Any 
other questions of eligibility, like for example, vvheiher a candidate lia.s 
passed a qualifying examination should be a roiiline check for the examina- 
tion.s office. The applications arc also scriiiiniscd to see whether the Iteads 
of dcpartmeiit.s have recommended them 

Dates far the receipt of applic.ui.vns anvl for the commencement of exa¬ 
minations arc determined by the Senate of the uiuv crsiiy. Wh.ilc 95",, v'l' 
the student population will adhere to the .schedule of dates the univeisuy 
will have to make some allowance for the balance 5 as well. Late appli¬ 
cations should and can be entertained upi.o about a vvecl, froiii the closing 
date. Late fees should be charged for this purpose. It will be ideal if late 
applications can be avoided altogether This will lend to case up the burdei'i 
on the clerical staff. 

To .schedule correctly the applic.ui-.vi^ roceivevl is very central i-.i ih. 
entire process of conducting an cxammaiion 'ftie sciicdule.s have to be 
quite accurate with rcg ird to the inrormaii in tl' ti is transferred on to iiieiii 
from the individual applications of cattJidale.s. On this will depend the 
seating arrangements, the number orque,si'on p.iper.s lo be packed, the lime 
table and above all the very conduct .vf the examiiiilion itself. In'iccnraie 
information in the schedule might lead to serious clashc.s in the lime table 
Schedules should therefore be entrusted to seni vr clerks of experience wh ' 
can undertake accurate work. 

We had the experience of writing out the mark book afresh (enterintt 
the index numbers and names of candidates and other relevant data) in u 
thick leather bound volume which remained the permanent record ol iliv 
university. This was done until recently but with the increase in the number 
of candidates. W'c have adopted a less time consuming device. 
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The schedule is typed in triplicate. The original copy of the schedule 
will form the mark book of the examination ultimately and this is bound in 
leather. This eliminates the rewriting of the schedules in the form of a 
mark book. The second and third copies are used to conduct the examina¬ 
tion. With this method we have found that the results of the examination 
could be expedited. It now takes a shorter time to enter up the results. 

The use of mechanical aids in some of the university examinations 
needs close study. Few examinations in universities, like the Special Degree 
examinations and all higher degree examinations can be excluded from this 
problem altogether. In instances where universities arc faced with holding 
entrance examinations or as in the case of some faculties where large num¬ 
bers sit for the bachelor’s degree examinations, mechanical aids will undoub¬ 
tedly have some meaning. This que.stion, however, needs to be looked into in 
the context of the much wider socio-economic problem of unemployment. 
Mechanical aids are necessary but in introducing them no employee should 
be displaced from employment. Mechanical aids are not used in the exa¬ 
minations of the University of Ceylon, Colombo. 

It had been the practice for our university to hold all its examinations 
more or less during the same period without any significant gaps in between. 
Due to various factors this was changed in 1970 and the examinations were 
staggered. We have found great advantages in a scheme of this sort. It 
tends to case up the work for the administrator, the supervisor and invigila¬ 
tor alike. 

If the examinations are staggered then the problem of accommoda¬ 
tion too cannot be so pressing. Normally we conduct all our e.xamina- 
lions in the university building.s. In a few rare instances we have been 
compelled to hire outside accomniodatioii. Although halls and chairs 
can be hired it is not at all possible to hire desks. These are not readily 
available. This is a problem that most of the universities are faced with 
in Ceylon and 1 believe it is common to many countries. The problem is 
aggravated because during the lime the imi\'cr5ity examinations are held the 
schools arc in session. Accommodation in schools cannot therefore be taken 
into account. In view of these difficulties the need to siaggcr c.xaminations 
seems to be very necessary. 

All arrangcnicnls for ait cxainiiiaiioit must he clirccletl from a central 
office, however, large may be the number of candidates and the centres to 
be dealt with. This not only helps those who are responsible for conducting 
the examination to know that adequate steps have been taken foi the success¬ 
ful conduct of the examination but also ensures that the arrangements in 
one centre do not dijfer from those of another. This guarantees uniform 
and standard procedures. Where centres outside the university have to be 
organized such arrangements should be entrusted to the supervisor who 
should act under direction from the centre. It should be his re.sporisibility 
to organize the centre and the successful conduct of the examination will 
depend on the resourcefulness of the supervisor and his invigilating staJT. 

When the University of Ceylon conducted the entrance examination 
on an all Island basis, there were several centres in important towns. The 
entire operation however, was controlled from Colombo. Great care was 
taken in selecting the supervisors. Only the professors or senior lecturws 
Were selected for this purpose. The question papers were printed at the 
University press and the papers for the whole examination which lasted 
for nearly two weeks, were handed over to the supervisor a few days before 
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the examination was due to commence. It was his personal responsibiliiv 
to ensure their safety. This examination was conducted very well, bui 
in 1964 in view of the expenses and in order to bring about some uniformity 
among the four universities of Ceylon, admissions were based on ihe results 
of the G.C.E. (Advanced Level) examination. What needs to be empha¬ 
sised is the fact that while certain arrangements can be decentraliseci tli!,- 
printing of question papers and other areas of a confidential nature must 
be centralised. 

It is very unlikely that most unisersities will have special buildings, 
as some western universities have, for the purpo.se of conducting c.xamina- 
tions. It is, therefore, not practicable to have any pre-determined seating 
plans. Much would depend on the type of accommodation that is as ailable. 
Lecture halls, tutorial rooms, theatres, can be used to conduct c.vaniination, 
and the seating arrangement would largely depend on the size and shape 
of the building used. It is. however, desirable to arrange the desks in row.s 
leaving sufTtcient space between row>. This will facilitate the distribution 
of question papers and the collection of scripts. In arranging seals we lend 
to allow about 8 sq. feet per candidate. In certain types of c.^airunatioiis 
like for example map work in Geography we proside 2 desks to a eanJidaic 
and much more space than for other papers. 

The custody of examination material should be in the hands of the 
examinations branch of the university. This would include v arious kinds 
of stationery for the examination including the answer books, the applica¬ 
tions, schedules, attendance sheets, admission card', mark return sheets, 
the mark books and other relevant papers regarding the evaminaiion 
These cannot and should not be left in a central record room or store:.. Quc'-- 
tion papers and documents of a confidential nature must be in the per.sonal 
custody of the staff officer. 

It is very essential to detail a clerk from the examiiialions oHiee for the 
sole purpose of distributing stationery to e,\aminaiion centres, lie shoiild 
be fully conversant with the requirements of the examination. .\ny special 
kind of instructions regarding the supply of graph paper, log tables, drawing 
and tracing paper should be given to him in advance. .Similarly all material- 
including clocks required for an examination .should he got ready at least 
two days before the examination is due to commence. 

In recent years wehave exercised a greater decree of control than hither¬ 
to over the distribution of answer books. Each answ er book i' tlaie stamped 
with the official seal of the Assistant Sccrciarv I;\amiir.itions. Thi.s ha- 
been introdued in order to prevent the introduction of an-wer script- 
written before hand. 

The marking of attendance at an examination is equally important. 
There must be attendance lists in re.spect of separate subjects for each exa¬ 
mination centre. We u.se printed form.s for the purpose which have columns 
for the index number and for the marking of attendance. Those who are 
present are marked by a tick and those absent are marked ‘absent’. One copy 
is enclosed with the packet of answer scripts and this enables the examiner to 
know the total number of absentees. The other copy is returned to the 
Assistant Secretary Examinations direct. This enables an independeni 
check of the absentees. We go further in this matter. Special printed 
forms of the same size as answer books entitled "Absentee Forms” are 
supplied to each centre. If a candidate is absent for any reason whatsoever 
an absentee form is substituted in place of his answer script. This method 
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is helpful especially in cases where the question paper has to be answered 
in separate parts, crich pari being packed separately, 

A few years ago we had the experience of ihe supervisor distribuling 
ai 9 a.m. the que.stion paper that was meant for the afternoon. This caused 
an unexpected emergency at the examination centre and adequate steps have 
been taken to prevent a recurrence. Since then we have had no emergencies 
in examiations except a very rare case of copying if that can be called an 
emergency. Emergencies cannot be handled from a central office. They 
must be handled immediately and without loss of time by the supervisor 
and his team of invigilators. If there are any mistakes in examination 
papers sup.rviors ha\c instructions not to correct them but to report every 
such case. In an emergency much would depend on the resourcefulness 
of the supervisor and his invigilators and great care should be taken in their 
selection. However, it is inevitable that the registrar in-charge of exami¬ 
nation must be kepi informed and consulted at every stage. 

In our own university the number of candidates falling sick in examina¬ 
tion centres has been a regular feature in recent years. The reports received 
by the university indicate thal this is due to overstudy and breaking of rest 
during the last few days before the examination, trying to do in few weeks 
what must have been done over the years. The university has its own medi¬ 
cal centre with qualified stalT to deal with emergencies of this nature. Since 
the general hospital is .situated in close proximity to the university any 
urgent cases could he despatched to hospital atonce. 

This probL'ni has not been adequately studied so far by our univer- 
,oiy. The incrcu.se in the number of candidates falling ill during the examina¬ 
tion tends to show that special instruction on how to study will be of immense 
advantage to univeraity students. 

Supervisors and Invifiilators are appointed by the registrar from the 
academic .stalT of the (.niversity. Special consideration is necessary in the 
appointment of the supervisor. Normally he is selected from among the 
mcmber.s of the .senior staff w ho have vvide experience in conducting examina¬ 
tions. Active, iiiiexciiable and calm and collected individuals are the best 
for this job. 

Supervisors liavc .ibsoliiic control of the evaniinaiion centre. If in 
I'lc opinion of an invigilator a candidate is guilty of disorderly conduct he 
vluill warn him and if he persists in his disorderly conduct he can be exclud¬ 
ed fioin the cxainiii.ition. If ciicumsiaucc.s arise which in the opinion of the 
supervisor render nee-'^.s-iry ihe eaneellation. t postponement of the evami- 
iiaiion, he can stop ihe examination anvl eolleei the scripts already written 
and report the niaiter to ilie vice-ehaiicellor. 

The invigilator is emp.'vvered to request any candidate to make a staie- 
iiieiit in writing vin any mailer which may have arisen during the course ot 
ihe examination. If in the opinion ol an inv igilator at an e.xamination cir¬ 
cumstances arose which rendered the examination unfair to the candidates 
he should report the mailer to the vice-chancellor. 

No candidate is admitted to the examination hall after 30 minutes have 
passed from the c.immencemeni of the e.xamination and no candidate may 
leave the examination hall until thirty minutes hav e elapsed after commence- 
nient of the examination. 

A candidate is issued an admission card giving his index number. 
He is required to write only his number in the answer scripts. No book 
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or paper or printed or written document other than those authorised by 
the registrar may be taken to the examination room, nor can a candidate 
receive such documents from another person while he is in the examination 
hall. The invigilators have been advised to enforce this even before the 
candidates are admitted to the hall. Candidates are permitted to enter the 
hall only from one entrance and under the direct supervision of two invigila¬ 
tors. They arc advised not to take any books or notes to the examination 
hall. Once they have been forewarned any violators of this rule could be 
severely dealt with. 

Where a candidate is found to be in possession of any such book or 
paper or documents he is deemed to have contravened the regulations un¬ 
less the contrary is proved. No candidate shall read anything written by 
any other candidate or speak or otherwise communicate with any other can¬ 
didate in the examination room or person outside the examination room. 
No candidate shall knowingly permit any other candidate to read anything 
written by him or to see any diagram or picture drawn by him, nor shall a 
candidate conduct himself so negligently that an opportunity is given lo 
any other candidate to read anything written by him. 

The conduct of an examination require.s .several confidential areas ic 
be handled, before and after the conduct of an examination. The ball is 
set rolling long before the dale of the examination, by gelling the c.xamincri 
appointed by the faculties and the Senate. The registrar circulates confi¬ 
dential instructions to the examiners requesting them lo set their papers and 
to transmit them to him before a given dale. The papers are scrutinised 
by a board of scru'.iny appointed for the purpose by the faculty and 
the Senate. The maximum number on the scrutinising committee i.s 5. 
This commit toe is at liberty lo modify any questions in respect of language 
or to refer any papers lo the examiner with their suggestions regarding an\ 
questions that appear to be unsuitable or unsatisfactory. The rcgi.slrar 
is the secretary to the scrutinising committee. It must be emphasized that 
this work must be handled by a senior stall’ officer of the examinations 
branch. This function should not and cannot be delegated. 

As mentioned earlier examiners arc appointed by the faculty and the 
Senate. At the conclusion of each examination the answer scripts arc 
returned to the examinations office by the sup’ervisors who arc entrusted 
with the task of conducting the examination. These arc di.siributcd lo the 
marking examiners immediately after they arc received. As a general prac¬ 
tice the scripts arc not posted but arc distributed in the university van to the 
residences of the examiners. This is done by a clerk attached to the exami¬ 
nations office who obtains an acknowledgement from the examiner con¬ 
cerned. 

Confidential instructions are issued by the vice-chancellor regarding 
the method of marking and the manner in which the final marks should be 
returned. In all final examinations the scripts should be read by two exami¬ 
ners—one internal and the other external. It has been the practice to accept 
the higher mark provided there is no wide disparity in the marks of the 
internal and external examiners, if it is to the advantage of the candidate. 

The marks are returned to the Assistant Secretary Examinations 
who gets the most experienced confidential clerks to enter up the marks. 
According to rules determined by the Senate the Assistant Secretary tabulates 
the results for the consideration of the board of examiners. Only the 
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border line cases are left for the consideration of the board. This does not, 
however, prevent the board from going through the marks of all candidates 
to determine their results. This often happens, and, it is a desirable 
feature that cros.s checks are made at different points. The results as deter¬ 
mined by the examiners are published by the registrar. 

The press in Ceylon publishes the results of university examinations. 
However, it is the obligation of the university to communicate to each can¬ 
didate the results of his examination. It is worthwhile mentioning the fact 
that at the t'me a candidate applies for the examination two envelopes— 
one marked ‘admission card’ and the other marked 'results’ respectively are 
issued to candidates. They are required to write their names and addresses, 
affix the postage stamps and return the envelopes with the applications. 
This has made matters considerably easier to us when sending the admission 
cards and the results. Time is not wasted in writing out the addresses of 
candidates and there is also no expenditure to the university. 

The problems connected with the declaration of results raise an impor¬ 
tant question. .A.s it is, in a given discipline, there are a few teachers who are 
directly involved in the teaching and e.xamining in the subjects. Invariably 
the same teacher is called upon to assess the answer scripts of several 
examinations at the end of an academic year. He may have a few hundreds of 
.scripts for each of the first, final Part 1 and final Part If examinations. All 
these have to he assessed before a particular date. Are our academics over¬ 
worked in this respect and as a result do the answer scripts receive a fair 
assessment? If they don’t what is the solution? 

Having conducted the examinations of the Univers'ty of Ceylon and 
of the lJniver''ity of Ceylon. Colombo, for over fourteen years, 1 begin to 
wonder whether the work that is put in by all. namely, the student, the teach¬ 
er. the administrator and the expenditure incurred in making elaborate 
arrangements is worthwhile. Internal university students are admitted 
on the results of a competitive examination. They receive instruction from 
experienced teachers, their progrc.ss is assessed in every tutorial they write, 
they are guided in their reading. Assuming that we have qualified and 
experienced slalf. on whose judgement we could rely, cannot the progress 
of a student be assessed progressively during his 3/4 years stay in the univer¬ 
sity and a pas.s degree awarded without requiring him to sit for an examina¬ 
tion. It must be made obligatory for those who rquire honours to sit for 
an examination. 
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Concuct 0 - examinations 

SARAI^JIT SINGH 


One of the glaring del'ccb in the present s\sleni of e\aiiiin:ilion'i is thiil 
the result is declared after 2 to 3 months of the holding of ihe examination. 
There are various reasons for this delay and the object of tins paper is to 
suggest a way of reducing this time to the barest minimum. I'or this, the 
system adopted by the Indian Institutes of Technology at the joint entrance 
examination is commended. 

The admLssion to the Indian Institutes ofTcehnology. liombay, Delhi. 
Kanpur, Kharagpur and Madras is based on the result of a common competi¬ 
tive examination called the joint entrance examination. Large number 
of candidates appear in this examination. Previously Ihe total number of 
candidates used to be as high us 25.000 but rccchilv this number has come 
down considerably. There are four subjects in which the Miidents ha\c to 
appear at the examination and the result is declared within four weeks of 
the last day of the examination. It will therefore be of interest to study in 
detail the mechanism adopted for this examination and see how it could be 
incorporated by other universities with .some modifications to .suit local 
conditions. 

For the purpose of the joint entrance cxaminutioii the country is divid¬ 
ed into 5 zones. Each zone is attached to an Indian Institute of Technology- 
Each Indian Institute of Technology is then responsible for the conduct 
of the cxaminiiion and preparation of the result in its own zone. After the 
last day of the examination the amswer .scripts of all the candidates in a zone 
are brought to the inslilulc responsible for that zone. The answer scripts 
arc then straightaway .sent to the coder who is re,sponsible for the preparation 
of the result. The coder, with hi.s own loum of highly trusted persons, 
allocates code iiumbeis and then the scripts with the code numbers arc sent 
to the respective head examiners in the subjects for evaluation, Each head 
examiner has his own team of evaluators and scrutineers. They carry out 



the evaluation at the centre within 5 to 6 days and send the award sheets to 
the coder. When all the answer scripts in all the subjects have been evaluat¬ 
ed and award sheets have been received the result is then tabulated and 
decoded. The zonal re.sult is thus ready within 18 days of the last day of 
the examination. The result of all the zones is then brought to one Indain 
Institute of Technology by turn each year and an all-India Merit List is 
prepared. The result is then ready for declaration. The whole process is 
completed within 4 weeks. A similar procedure if adopted by the univer¬ 
sities will go a long way in decreasing the gap between the last day of the 
examination and the declaration of the result. The delay at various stages 
will be radically cut and the result can be prepared in a short time. In fact 
the last step of compiling the all-India result will not be necessary in the case 
of the university and it coiikl very well mean a further saving of one week. 

There are many obvi'ui* aiKaniagcv in this system and some of these 
are enumcrateJ below ; 

1. Coding is in ili.- iraiv.ls of independent persons who are not con¬ 
nected with the evaluation of the .script.s. 

2. All the evaluator^ in a subject are to sit at one place under the 
continued presence of the head ixaminer. The head examiner 
has already prepared a model answer (at the time of paper setting) 
which will he availabk to all the other evaluators in the room. 
Lack model answer h.is been siih-divided into di.siinct steps and 
each step is allotted marks. Consequently, very little discretion 
is left with the evaluator and he can only err within very narrow' 
margin. This cnMircs uniformity in the standard of marking which 
at present, in some universities, is achieved by sample checks of 
answer scripts by licad examiner or by two independent markers. 
Obv iously sending scripts by post and exchanging information by 
correspondence takes lot of time and still uniformity in marking 
cannot be achieved to the same extent as is possible by personal 
con'act. 

-k Greater participation by other examiners under the guidance of 
head examiner, besides imparling training, will remove some of the 
criticism that only a few persons are favoured with this so called 
remunerative work. 

4 The short time at the disposal of the examiner minimises chances 
of any external inlluence aflectingthe assessment. 

5. The coder being an independent person and a man of high integrity, 
the chances of'leakage of code to the advantage of an interested 
candidate are minimised if not eliminated. 

There mav be some more advantages which can emanate from local 
conditions. 

However, objections can be raised against the above system in the light 
of the background, of the sysiems prevailing in different universities. For 
instance, it may not he convenient to gather examiners at one place. Thai 
may look .so at first thought but I do not think that this is an insurmountable 
diTiculty. The same objection could be raised against the head examiner 
being asked to spend .S to 6 days at one place for the examination of the 
scripts. This clilficulty may ari.se in very few caiies vx'here the examiner 
comes from far olT regions. Generally the iiniversilie.s within a small 
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zone follow the same semester or academic schedule. As such many of ths 
examiners will be available who could spare time and finish the job quickly. 

T do not claim that this will be the cheapest and the most economical 
method of evaluation but I am confident that the cost difference between 
the above suggested method and any other method followed at present 
in any other university will not be large. Even if it is conceded that there 
is small economic loss yet it will be more than made good by the elficiency 
and saving in time which i.s ensured by the above suggested method. 

I will therefore sincerely commend the above procedure for adoption 
by the universities. Once the principle is accepted then it will not be difficult 
to work out the details to suit a particular univesrity/institutc. 

The Indian Institutes of Technology are already using computer for 
part of the process and I am sure the universities will also be able to incor¬ 
porate this technique later on in their system. 


198 



Cone net o: examinations 

N K. DESAI 


Ont or TiiF most important work of the registrar's office is the conduct 
of examinations. All univcrsitie.s base prescribed under ordinance the date 
of receipt of application forms for each e.xamination specifying fees etc. 
According to the ordinance on that behalf, circulars are sent to the principals 
of colleges to forward the forms of students who arc appearing in various 
examinations. 

The application forms are forwarded about two to three month.s before 
the examination commences and the terms are also not over by that time. 
All these forms are forwarded by the principal to the university during the 
term. After the close of the terms, the principals send attendance and 
certificates regarding completion of term work etc. to the university. Theie- 
afiei the admissions of the candidates are confirmed. Sometimes this is 
done ver) late and very little time is left with the university office to inform 
the candidate as well as senior supervisors appointed at the examinations 
if the provisional admission of u candidate is to be cancelled. 

The second problem is of the eligibility of siiidenis migrating from 
other universities. These students are normally admitted to the colleges 
affiliated to the university provisionally on production of an evidence of 
passing the qualifying examination. Conlirmalion of their admission 
depends on completion of certain additional formalities. Either the stu¬ 
dents do not care to complete such formalities or the universities from 
which they migrate do not give them adequate help by way of issuing certain 
certificates like passing certificate.s, migration certificates etc. which are 
required for gianting them final eligibility certificates. 

As the majority of students who come from other universities fail to 
produce evidence of their eligibility for admission before the commencement 
of the examinations, they are provisionally allowed to appear at the exami¬ 
nation and their results are withheld. Such students come personally to 



the university ofTice and disturb the office during the peak season. Princi¬ 
pals of colleges should be requested to see that students studying in their 
colleges complete all formalities for admission to the examiniilions. 

The examination section faces another problem, i.e.. late submission 
of admission forms by the principals. The forms come as late as one or two 
days before the commencement of examinations. By this time the office 
has already completed the work of scrutiny of applications, their classifi¬ 
cation according to centres and optional groups and subjects, allotment of 
seat numbers and printing of the list of candidates. The late receipt of ap¬ 
plications increases the work for the examination section and disturbs the 
smooth working of examination machinery. Such candidates arc to he 
given seat numbers and senior supervisors and examiners are to be informed 
about tlicir admis.sion to the respective examinations. Principals of aHi- 
liaicd colleges should be requested to.sce that no applicalioiis are forwarded 
after the due dales except under very special circumslances which ihc princi¬ 
pal also should mention in ihcir forwarding Idlers. The allowance ofal- 
leasl a week should suffice for late submission of application forms afler 
due dates. 

As soon as the forms are received in the office, they are to be classified 
according to the centres and optional groups and subjeeis. Thev are also 
to be arranged alphabetically and given seat numbers. Principals of c.'l- 
eges at times d .v not see that their offices make a thorough check up of appli¬ 
cation forms and therefore much ofthe queries are lo be solved by the ev.imi- 
nation seclion through the principals of the colleges. .Siudenis arc aUo 
called at universitp office for certain clarificalions. If this work is done at 
the college office properly, the examination seclion can prepare the sialc- 
ments giving full details regarding .subjects in which how many students are 
appearing and how many students are claiming exemptions lit various sub¬ 
jects without difficulty. Unless such sialement.s are prepared and given to 
paper-setters and examiners in time they may not be able to do their work 
satisfactorily. 

During this stage, one unit of examination section is busy in issuing 
appointment orders to paper-setters and examiners and receiving accept¬ 
ance from them. They arc also to be supplied with necessary stalionery for 
the purpose. The paper-.setters should also get the printed or cyclostylcd 
copies of syllabi and text-books prescribed for the 'examination-Thc informa¬ 
tion regarding the courses of study and text-books should be kept up-to-Jaic. 

The manuscript should be set fifteen days before the examination com¬ 
mences. The paper-setter should co-operate in this work- At times they 
do not submit the manuscript in time and create an unseemly situation for 
the university. Sometimes paper-setters accept the appointment and refuse 
it at the last moment leav ing the office very little time lo make alternative 
arrangements. 

In most of the universilies. question-papers are printed on the day of 
examination. Very few universities get queslion-paper,s printed in advance. 
Residential universities do not have many problems in getting tlie question- 
papers printed. as they have only one centre. But affiliating universilies 
have problems of getting question-papers printed at .several centres. Such 
universities have to make arrangements of priming question-papers at 
many centres and at some places proper arrangements for printing them can¬ 
not be made. At such centres, the question-papers have to be carried daily 
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from the nearby centres M^here proper facilities are available. Examination 
centres have to be approved at all places where colleges are situated. 

The manuscripts are sent to the senior supervisors at all centres an^^ 
they are made responsible for printing of question-papers at their res¬ 
pective centres. Senior supervisors appointed at various centres are also 
responsible for other work relating to the conduct of examinations. The 
MSS are sent to them three to four days before the commencement of exami¬ 
nation so that they can arrange to print the question-papers in the subjects 
concerned on the day of the examination. 

All the stationery required for the conduct of examinations is normally 
sent to the principals of the affiliated colleges where the centres for exami¬ 
nations are located. The principal is asked to recommend a responsible 
person from his college staff (hat will look after the examination materials. 
Affiliating iinivcrsitic.s arc al.so having the problem of despatching the answer- 
hooks to examiners. If the university has colleges within a range of few 
miles and answer-books can be collected by evening at the university office. 

It can despatch the answer-books on the next day; where the geographical 
.situation is such that the answer-books cannot be collected on the same day 
or next morning at the university office it is advisable for the registrar'.s 
office to see that the answer-books are directly sent to the examiners. In 
that ease the principal may be requested to recommend the name of some 
responsible stall member oi'his college who can do such work eificiently and 
with utmost secrecy. 

The next important thing in the conduct of examination is the appoint¬ 
ment of invigilating staff. Some universities are appointing directly such 
staff whereas others entrust that work to the principals of colleges where 
the examinations arc conducted. The best course for the e.Ticient conduct 
of examinations is to ask the principals of the colleges to recommend as many 
names as arc required and got it approved by the university. The principal 
should also be requested to recommend names of senior stall members 
who could work as senior supervi.vors. These senior supervisors should 
appoint Junior supervisors from the list approved by the university. Prin¬ 
cipals should be associated with each cxaminaiion as senior supervisors as 
they have better control over the staff of the colleges who arc engaged in 
supervision and other work relating to examination-' at centres. 

Before the actual commencement of each examination, the university 
must have an up-to-date information reg-arding the seating accommodation 
(hat will be available in each college, such as the number of class-rooms 
(hat will be available, the number of students that could be accommodated 
etc. On the basis of this information the registrar'.s olTice should arrange 
for seating accommodation for the students in each college. 

Senior supervisors appointed at the various examinations at different 
centres should also be strictly instructed to see thar the copy ol the reports 
filled in by junior .'Upervi.sors of all blocks are forwarded to the i niversity 
office. Tliis record will be useful iii knovving the number of students ap¬ 
peared in each subject at different centres. It is als.v usfeul. in case, any 
complaint is received from the examiners. 

During the conduct of examinations, there are many chances of emer¬ 
gencies of an unpredictable nature creeping in. There may not be any 
time left for the 'cnior .supervisor to contact the university. Under such 
circumstances, it is better to give ,somc authority to the senior supervisors to 
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act according to his judgement. It is always advisable for the university to 
leave the problem of handling emergencies to the best Judgement of the 
man on the spot. His decision should be considered as final. 

The invigilators appointed at university examinations should under¬ 
stand that invigilation is an important factor in the successful conductor 
examination and the efficiency of supervisors has a direct impact on the 
conduct of examinations. Senior supervisors should exercise utmost care 
and see that cases of malpractices are detected and reported to the univer¬ 
sity, They should take frequent rounds so as to make junior supervisors 
more vigilant. Students should not feel that they can bring anything that 
they like and can go on copying from b-.tok.s or written pieces of papers or 
from their neighbours. Junior supervisors should also fill in the reports 
efficiently and with due care. No mistakes .should be allowed to creep in 
such reports. At times wrong reports may create a dilficult situation for ihc 
university. A candidate who is present might have been marked absenl 
and a candidate who is absent might have been marked present. At times 
the candidate may write a wrong number. A candidate might write more 
supplementaries than actually tied along with the main .supplementary. He 
may tie blank supplementaries and deceive the university. All the.sc things 
should be properly reflected in the reports. 

Where the university has no direct control over the examination centres, 
it is worthwhile to appoint a few people who could go round the examination 
centres and printing presses on a siirpri.se visit and see that the work of the 
conduct of examination is carried on elficiently. They may also suggest, 
if necessary, some ways and means to improve the sy.stem of conduct ul 
examinations. Their reports should be placed before the higher ituihoriiies 
and their suggestions for improvement of the .sy.stem may be considered by 
the authorities of the university. 

Most important factor in the conduct of examination is of course the 
examinee himself. It is not advisable to ignore him. He soiild never feel 
that he is not given any facilities by the university at the time ofexaminaiioii. 
His minimum needs like cool drinking water, g.vod sanitary facilities, fans 
etc. in hot season should be provided. If he needs any facility in the e.xami- 
nation hall he should get it. Supervi.sors .should not ignore him. His 
needs are likely to be few and they should be saiisliecl. He should n it feel 
that he is neglected. Students should be given.maximum comforls diirine 
the examination so that they may not have any reason to complain about it 
and can write the question-papers at ease. 

The correspondene between the examiners and university office 
should be treated as most confidential. Examiners .should not divulge the 
information he gets about his colleague nor he should inform others that he 
is examiner at such and such examination. This particular work of corre.s- 
pondence with paper-setters and examiners should be rc.slricled to few per¬ 
sons in the university. They should never give out this information to 
others. It has been a practice in recent years that students do not read during 
the whole year and after the examination is over, they hunt for the addresses 
of examiners with a view to approaching them for liberal marking. Thi.s 
has been the trend during the last few years and must be discouraged. Dummy 
numbers are suggested to discourage this trend. In the university ofhcc 
only persons of highest integrity should be entrusted with this work and the 
despatch of answer-books also should be done by them. The candidalc’.s 
real identity should not be known to examiners even indirectly. 
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Tn some universities there is a system of tabulators and collators or 
verifiers. The tabulation of marks are done by them. The results are 
tabulated by them and submitted to the university office. The university 
office has only to publish the results. But in most of the universities results 
are tabulated by the office. Most of the staff members from various bran¬ 
ches of university office arc pulled together for examination work. They 
are entrusted with the work of tabulating the results. Marks are checked 
and rccheckcd and then they arc entered in the result-sheets. Totals are 
prepared and checked by them. The senior persons are asked to prepare 
the final rc.sulls. In most of the universities results are tabulated on mach¬ 
ines. Mark-sheets arc also prepared on machines and they are supplied to 
affiliated colleges for distribution to the students. Fees for mark-sheets 
are collected along with examination fees. In new universities, all this 
work has to be done manually by the staff members. 

The filial stage of conduct of examination is compiling and declaring 
the results. The registrar's office has to be very careful in compiling and 
declaring results. The results should be declared as early as possible. At 
the same time the results of many major examinations should not be declared 
so that the office may be able to cope up with the work of issuing marks 
certificates and passing certificates. It should be the endeavour of any 
unisersiiy to declare the results of students as early as possible immediately 
after the examinations are o\er. Arrangements to issue marks certificates 
to the students without loss of time should also be made after the declaration 
of results. 


203 



Arrangements at examination Centres 

S. SANTANAGOPALAN 


For efficient conduct of examinitions certain preliminary' arrangements 
are necessary. The people connecicd wiih the conduct of evaminations 
should be faithful and honest. 

The problem of conduct of examination'! at dilTereni centres is more 
complicated now a days. With the introduction of supplementary exami¬ 
nation and semc.ster examination for the postgraduate course,s and profes¬ 
sional course, the number of examinations held in a year are many though 
the candidates are less. The number of question papers has been consider¬ 
ably increased. 

The conduct of examinations starts with the despatch of que.siion papers 
to the different centres. The way in which question papers are packed and 
sent to dilTcrcnl centres is umy important. They should be secretly packed 
and .sent in a sealed cover. The postal deparlmcni has a great responsibi¬ 
lity to sec that these packets arc safely and expeditiously delivered at the 
centres. The mode of delivery and lime at which these .should be sent to 
the centres need special attention. 

The person who is entrusted with the responsibility of conducting the 
examination, should be a man of high calibre. He should be a principal 
or a senior professor of 15 to 20 years’ standing who could be entrusted with 
such a heavy responsibility of confidential nature. For the conduct of the 
examinations, the aaswer papers are normally despatched to thediTercnl 
examination centres without any damage ahead to the commencement of 
ibe examination and the question papers stiould be ctvecked tkpcTson 
in-cbaige ot Ik examination and kept in safe custody, it sbouid be the 
personal responsibility of the person concerned to get them in tact without 
being noticed or handled by others. It has been reported that the chief .sup¬ 
erintendent with or without connivance of other teachers open the question 
paper packets a day before the actual date of examination and thus release 



question papers “as probable questions”. The motive is purely selfish and 
is for getting better results for their own colleges. From the moral point of 
view, this is most degrading. Recently, there was a case in an institution in 
our area where a principal acted like this and later he indirectly accepted 
the mi.stiike. During the conduct of the examination, there should be per¬ 
fect supers'ision and for that purpose the whole thing depends upon the 
invigilating staff. Due to the general deterioration in the moral standard of 
the community, the students are no exception. In certain cases, the students 
are also induced by the teachers to use unhealthy practices in the exami¬ 
nation. Their only objective seems to be to make the students pass the 
examination somehow by securing higher or good mark.?. 

APPOINTMF.M f>F INVIGILATIVG STAM 

So far as the appointment of invigilating .staff is concered, it would be 
advisable not to rely entirely upon the superintendent of examination centres. 
It would be advisable to associate teachers from different institutions so that 
there may be a check and also a moral binding on the people in-charge of 
the examinations to follow the rules and regulations laid down by the uni- 
versitv. It is, therefore, suggested that at least 50% of the staff appointed 
for invigilating vsork should be from other colleges. High school teachers 
Cv-iuld not be engaged for invigilating work, ft has been our experience that 
in certain cases invigilaters from neighbouring institutions do not like to go 
for invigilating work in some colleges for obvious reasons. The univer¬ 
sity had taken a strong view of this and tried to send an officer of the university 
to go round the various examination centres to see whether the examinations 
are conducted according to the rules and procedures laid down by the univer¬ 
sity. Various cases of lapse.s were brought to our notice. There was a 
resentment on the part of the colleges for .sending such representatives of the 
university. Anyhovv. for the fair and normal conduct of the exaniinaiions. 
it would be nece.s.sarv to as.sociaie members of the sta'f of the neighbouring 
collcge.> and send the officcr-in-charge of ihe examinations to make surprise 
visits to centres of examinations. 

.SEATING ARRANGl .MFNT.S 

The university examinations should preferably be conducted in large 
hall.s vvhere almost all the candidates can be aeeomm.idated. But in certain 
college.s a number of room-' in the same block or in separate blocks are 
used for the conduct of examinations in view of large number of candidates, 
including private candidates, taking their examination at one centre. In 
such places, there should be proper supervision and the chiel superintendent 
should make a point to ti.sit each room or building as frequently' as possible 
to see that the rules are followed. The candidates should be seated well 
apart from one another. A minimum of 15 to 20 sq. ft. space should be 
provided for the examination hall. The candidates should also be provided 
w'ith nece.ssary convenience like, writing tables and separate chairs. It is 
the practice in some of the colleges to use desks for examination purpose and 
writing desks arc used and two to three students are put in each desk. This 
w ould lead (o unhealthy practice by the students. Even if candidates writing 
different examinations are put in each desk, there is no guarantee that rnal- 
. practices are avoided. It would therefore be necessary that as far as possible 



candidates should be provided with separate tables and chairs and proper 
spacing should be given in between two candidates. As far as possible, 
lady students should be placed apart from men candidates. Normally, 
separate centres should be provided for women students. It would also be 
the condition that in no case a candidate should be allowed to take a seat 
other than that allotted to him in the examination hall. Scats of absentee 
candidates should be left vacant. 

All candidates should be asked to take their places at lea.st live minute.s 
before the time fixed for giving out the question papers. Otherwise a chaos 
would occur in the e.xamination. It would be better to have a calm atmos¬ 
phere when all have taken their seats at the time of distributing question 
papers. Otherwi.se correct question papers will not be issued to candidates 
and this would lead to unnecessary complication. 

The question paper covers should not be opened until Ihc candidates 
have assembled in the examination hall. The covers must be examined and 
opened by the chief superintendent in the presence of external invigilator 
who should sign in the space provided for in the question paper covers. 

A sketch plan showing the seating arrangements with the register num¬ 
bers in the examination hall certified by the concerned hall supcrintendeiil 
should be sent to the university. This would enable the university to check 
up whether proper scaling arrangements ha\c been made at the examination. 

Candidatc.s should not be allowed to enter the examination hall after 
the appointed time. N a candidate should be allowed to leave Ihc examination 
room till the expiry of an half hour after the quc.ilion paper has given out; 
and candidate who leaves room during the period should not be allowed to 
return within the period. If on rare occasion when candidates have lo lease 
hall for answering the calls of n iliirc or any emergency. Ihcy should be ac¬ 
companied by an assistant superintendcnl or a member of the teaching slajf 
of the college. 

DESPATCH OF ANSWrJt PAPI.KS 

As soon as the candidates complete their answers, they should stand up 
in their places and the concerned invigilators should collect the answer papers 
from the candidates immediately. Before the close of the examination the 
chief superintendent should allow only one exitTor the students and orie ol 
the invigilators should see that the candidates do not carry with them either 
the answer paper or any unused answ'cr books or additional books or papers 
except the question paper. 

The candidates should be strictly informed that the answer papers 
should be handed over to the invigilators before leaving the examination hall 
and they should not leave the hall unle.ss the answer papers arc collected 
from them by the invigilators. The candidates should not go out of the hall 
leaving the answer papers on the tables. 

The answer papers should be dcspatchd by registered parcel addressed 
to the controller of deputy registrar in-charge of examinations by name. 
In the case of city colleg’s, the papers may be sent the same date to the uni¬ 
versity. 

The answer paper issued lo the candidates should not contain the college 
office stamp or the initials or fascimile of the chief superintendent. 

The signature of the chief supcrinlcndcnt should not be affixed on 
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the answer paper covers. The station or the college name need not be 
entered on the covers. 

A slip of paper with the name of the college, date and signature of the 
chief superintendent may kindly be pasted at the bottom of the cover. The 
slips should be pasted only at the two ends so that they may be easily detach¬ 
ed in the office. 

A typted list in duplicate (one with the answer paper packets and another 
separately) containing particulars : 

(а) Centre 

(б) Name of the examination 
(c) Subject 

(J) Time and date of examination 

(c) Number of candidates registered 

(f) Number of candidates appeared for the examination 

(^) Number of absentees with the register number and 

(/i) Total number of packets for the examination may also be sent. 

UMLRGENCILS 

In the cas; of emergencies, the chief superintendent can contact the 
registrar and clarify certain things. If anything out of ordinary happens 
in the examination hall, it should immediately be reported to the university 
and their clear instructions obtained. The chief superintendent should not 
presume things for himself and act contrary to the rules and regulations of 
the university. 
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Arrangements for Examinations 

MADAN MOHAN 


The universities all over India, especially those where the number of 
examinees to be examined [s quite large, have been concerned over the dete¬ 
rioration in the quality of arrangements made for the conduct of examina¬ 
tions. The number of candidates reported to have resorted to the use of 
unfair means has been on the increase. Ca.scs of mass-copying at examina¬ 
tion centres have not been uncommon. In quite a few cases physical vio¬ 
lence has been resorted to, by examinees or others. Superintendent.';, invigi¬ 
lators and sometimes other persons connected with the conduct of examina- 
ions have been assaulted. A single case of assault at an examination centre 
or outside sets in motion a wave of demoralisation among those connected 
with the conduct of examinations. 

Before India attained independence, university education was the 
privilege of the elite, whose number was very small. Now it has come to be 
realised as a right for every citizen. There is no denying the fact that many 
of the universities have far outgrown the optimum strength of students and 
teachers. There are colleges running in three shifts. Student population 
is drawn both from urban and rural areas, from rich and poor sections of the 
society. Similar is the case with the faculties. This transition period of 
sociological adjustment between the various types is manifest with prob¬ 
lems of psychological behaviour between individuals. 

Besides regular students in colleges, there are other categories of candi¬ 
dates—external candidates, teacher candidates etc. who lak the examination 
as private candidates. A majority of such candidates are those who were 
considered to be inferior students in the schools. 

With all this overcrowding the number of candidates to be examined 
far exceeds the space available to examine them. Suggestions to hold exa¬ 
mination in shifts have not found favour with those concerned with academic 
standards. Phasing of the programmes of various examinations have also 



not been found acceptable, since it is considered necessary to have a uniform 
academic session for all the classes in the colleges and in the university. School 
buildings are not available for this purpose, since they have their own 
examinations in the schools about the same time. Hiring of private pre¬ 
mises for this purpose has its own problems. 

A related problem is the publication of the results of all the examinations 
before the commencement of the next academic session in author choice. 
Thus the examination schedule for the various examinations has to be con¬ 
centrated into a span of 40 to 30 days. 

The result of all this has been overcrowding of examinations and the 
resulting overcrowding of examinees at examination centres during a fixed 
period. 

The remuneration payable for the various jobs is not commensurate 
with the Job requirements. To provide safeguard against smuggling in and 
smuggling out of answer books and other means of cheating, various pro¬ 
cedures are to be followed. The deterioration in the norms of public beha¬ 
viour has its own deterrent value. 

With all this, the number of qualified persons availble for the conduct 
of examinations has been dwindling fast. Senior teachers shun to invigi¬ 
late at the examination centres for various reasons. 

Some years back, to assign to the examinees an examination centre other 
than their own college was a must. This was considered a safeguard against 
favourtism or mass-copying. Now an opinion has come to be formed that 
it is always advisable to as.sign the examinees their own college buildings as 
examination centre since otherwise they arc likely to create problems. 

The students punished for resorting to violence and unfair means go to 
law courts. The time taken by the judiciary to dispose of such cases is 
long. The court procedures arc sometimes embarrassing, if not humiliat¬ 
ing, for the stair connected with examinations. All this has discouraged 
efficient persons to come forward to help in the conduct of examinations. 

The following are some of the suggestions which may be considered to 
minimise the intensity of the difficulties outlined above : 

1. The examination for classes,other than the final year of the various 
courses, should be held first, so as to make it possible to publish 
their results before the commencement of the next academic ses¬ 
sion. The examination for the final years classes, especially for 
the terminal degrees, may be held afterwards. Because not much 
harm is done if their results are announced a little later than the 
commencement of the next academic session. 

2. The examinations for the students should be separated from the 
examinations of regular students of colleges and the same should 
be held some time during the vacation time. However, the final 
year examination of external candidates may be held along with 
others so that those of the external candidates who may wish to 
seek admission to the next higher course as regular students, in 
the event of their being successful may not be at a disadvantage. 

3. The rates of remuneration payable for the various jobs connected 
with the conduct of examinations be suitably revised so as to 
attract senior people to do the examination work. If that is not 
possible, the whole work should be made honorary, obligatory 

209 



and certain minimum invigilation sessions should be compul¬ 
sorily assigned to all the teachers in the university and colleges. 

Another method of drawing senior persons to examination work 
would be to request the principals of colleges to act as superin¬ 
tendents at the examination centres located in their buildings and 
to the professors of the university to act as superintendents in 
the centres located at the university buildings. 

4. The assigning of candidates of a college for examination in the 
buildings of the same college has its own advantages and disad¬ 
vantages. But in the present context of things, it seems to have 
more advantages than disadvantages. 

5. In order to detract students from the temptation of using unau¬ 
thorised aids during the examination, reforms should be intro¬ 
duced in the methods of examination, e.g., the suggestions already 
made to set question papers in such a manner as to allow free use 
of text books etc. may be seriously considered in this connection. 

6. In order to restore confidence in the academic community, the 
Government should seriously consider whether the law courts 
should have Jurisdiction over the decisions of the university in 
matters of violence and/or resorting to unfair means by candidates. 
In this connection, the establishment in each university of a legal 
cell constituted mainly of academic persons with one or two per¬ 
sons from the judiciary may also be considered. If that is not 
possible, there should be separate cells in the law courts to deal 
with university cases. 
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examinations and Unfair f^eans 

K.V, IRNIRAYA 


INTRODUCTION 

Tun CASTS OF unfair means may take place before, during or after the exami- 
nations. 

UNTAIR MFAVS BEFORH THE EXAMINATION 

Precaiilioiis to be taken at the time of setting, printing and distribution of 
(jiiesiion papers— 

Various stages in the examination process, ri:., setting of question 
papers, priming and their distribution imolve considerable administrative 
effort. The need to maintain utino.st secrecy regarding the paper setters, 
place of printing and the preservation of the question papers in safe custody 
cannot be overemphasized. 

It is desirable to get the question papers printed in the confidential 
section of the press assigning code numbers to avoid any scope for mal¬ 
practice. Adequate care should be taken while transporting the printed 
question papers to the university office and during their despatch to the 
examination centres. The chief superintendents should be instructed to 
keep the question papers in their custody. To ensure that the question 
papers are preserved in safe custody, surprise inspections may be taken up 
by the university authorities at times. Printing the question papers a few 
hours before the examination may be desirable and feasible in the case 
of universities having affiliated colleges confined to a limited area- 

Precautions to be taken at the time of receiving the applications : 

Impersonation is one of the malpractices committed by the candidates 



at the examinations. Candidates intending to impersonate plan their 
strategy at the time of sending their applications. The starting point is often 
a request for change of centre. One way of curbing this malpractice is to 
impose blanket ban on the practice of granting change of centre. However, 
this may affect some genuine cases as well. If such a drastic measure is not 
found feasible, the practice of granting change of centre may be restricted 
to cases recommended by the heads of the institutions on merits. In all 
cases of change of centre, submission of passport size photographs of 
the candidates should be insisted upon. The copies should be attested by 
the head of the instilution or a gazetted oHicer. One copy of the photo¬ 
graph .should be affixed on the admission ticket issued to the candidate and 
the other should b:; sent to the chief superintendent of the centre where 
the candidate takes the examination for purposes of reference and veri¬ 
fication. In the case of regular candidates, where scope for impersonation 
is less, the signatures, of all the candidates should be taken in the invigilators 
diary before the commencement of the examination every day. 

Precautions to he taken at the examination centre ; 

The chief superintendents are responsible for making seating arrange¬ 
ments in the examination halls. The seating arrangement may be changed 
from time to time to frustrate any plan to gel extraneous help. Care should 
be taken to ensure that the candidates do not change their scats without 
prior permission of the chief superintedent. The invigilators may be allot¬ 
ted to different rooms a few hours before the commencement of the exami¬ 
nation to avoid any possible collusion between the invigilators and the 
candidates. Posting of strangers as invigilators may go a long way in this 
regard. 

UNFAIR .MEANS AT THE EXAMINATION 

The modus operandi employed by the candidates to get extraneous help 
at the examination otfer an interesting study. Following arc some of the 
modes employed by the candidates. 

(1) Oral communication with another candidate nr a person inside the 
examination hall. 

(2) Communication through signs or gestures. 

(3J Passing information through paper bits, blotting paper, question 
paper, etc. 

(4) Smuggling in information in some part of the body or in instru¬ 
ment box. scales, mathemtical tables, etc. 

(5) Receiving information through water boys or attenders. 

(6) Leaving the examination hall in the midst and smuggling in manus- 
script or written matter from outside the hall. 

(7) Smuggling in answer books with matter written outside the exami¬ 
nation hall and inserting the same cnblock in the jacket of the 
main answer book issued at the commencement of the examina¬ 
tion. 

(8) Revealing the identity by signing or writing the name in the 
answer book or putting up an appeal to the valuer to award more 
marks. 
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(9) Copying with the connivance of the invigilator. The failure on 
the part of the invigilator may be due to ; (a) threat of physical 
harm, (b) monetary incentive, (c) affinity, (d) undue pressure, 
(e) indilference or a desire to get better results in the institution. 

CHECKS AND REMEDIES 

In order to check large scale smuggling in of manuscript or printed 
matter into the examination hall, a warning as worded below may be admi¬ 
nistered to all the candidates before the commencement of each session every 
day: 

'You should search your bag, desks and benches and hand over to 
me (superintendent) any paper, book or note which you may find therein 
before starting to answer any paper of examination.’ 

The chief superintendents should be instructed to give this warning to 
every late comer individually. The warning may also be printed on the 
admission tickets issued to the candidates which may serve the purpose of 
giving advance notice of the precaution the candidates have to take before 
proceeding with the examination. One way of preventing smuggling in of 
manuscripts, printed matters or answer books with the matter written out¬ 
side the examination hall is to prevent the candidates from leaving the hall 
in the course of the examination. Strict watch on the supervisory and sub¬ 
ordinate staff and total exclusion of strangers from the examination centre 
may go a long way in curbing this malpractice. 

It is desirable that the candidates are warned about the other types of 
unfair means and the consequences that will follow if they resort to them. 
A warning on the following lines may be printed on the admission tickets 
is.siicd to the candidates : 

"Any candidate having in his possession or accessible to him papers, 
books or note.s which might possibly be of assistance to him or found 
giving or receiving as.sistance or copying from any paper, book or note 
or allowing any other candidate to copy from his answer book, writes 
either on blotting paper or any other paper some questions set in the 
paper during the examination or using or attempting to use any other 
unfair means or disclosing his identity or making peculiar marks in his 
answer books Rir that purpose or using abusive or obscene language 
or communicating or attempting to communicate with the examiner, 
shall be debarred for a period which may extend to.years. 

Any candidate found guilty of deliberate previous arrangement to 
cheat in the examination such as smuggling in another answer book, 
impersonation or some other misconduct of a serious nature, shall be 
debarred for a period which may extend to.years.” 

The above warning may serve as a deterrent though it may not elimi¬ 
nate all cases of unfair means by itself. Much depends upon the standard 
of invigilation and supervision which in turn depends upon the integrity 
and efficiency of the personnel employed for the task. It is imperative that 
persons whose relatives are taking the examination and others who 
have imparted private tuitions should be rendered ineligible for this work. 
Likewise persons who are susceptible to coercion and local pressures should 
be spared of this work. The room superintendents and invigilators should 
be instructed to take rounds in the halls in performance of their duty. To 
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ensure effective invJgilations not more than 40 candidates should be allotted 
to each invigilator. Assigning independent seats to the candidates is an ideal 
arrangement. Two candidates may be permitted to write on the same desk 
with proper supci vision. Allowing more candidates on a desk may lead to 
copying. 

The malpractice of smuggling an answer book from outside the exami¬ 
nation hall and its insertion in the main answer book calls for skilful plan¬ 
ning. One way of checking this is by preventing any question paper going 
out of the examination hall immediately after its distribution. Such a step 
prevents an outsider preparing the answers for the candidate. In addition, 
the following steps may also be taken : 

(1) The answer books should bear serial numbers and the invigilator 
should enter the same in the invigilators diary agaimst the regis¬ 
tered number of the candidate taking the signature of the candi¬ 
date before the commencement of the examination. Whenever 
an additional book is i.ssued its serial number should be entered in 
the invigilators diary and the initials of the candidate should be 
taken. After the conclusion of the examination the chief superin¬ 
tendent should ensure that the candidate has handed over ihc 
answer books issued to him. 

(2) The answer books .should contain a .specific number of pages and 
they should be numbered. The candidates should be instructed 
at the commencement of the examination to count the pages and 
to report any discrepancy in the number of pages. This proce¬ 
dure may help check insertion of pages in the main answer book 
to some extent. 

(3) The candidates .should be instructed not to detach any pages from 
the answer books or to in.scrt any loo.se sheets. 

(4) The answer books should contain pages with the specific water 
mark to check insertion of different type of paper in Ihc answer 
book. 

(5) Often the candidates re.sort to the ingenious method orinserimg 
pages of an old answer book lasidc the jacket of the answer book 
supplied to them by removing and refixing the pins. In such 
casc.s the .serial number of the answer book and the water mark 
remain unaltered rendering the malpraeiicc committed dillicult 
of detection. Following checks may be employed in this con¬ 
nection : 

The chief superintendents should be instructed to maintain day to ila> 
account of answer books issued. After each examination the unused answer 
books should be withdrawn and fresh books should be i.ssued with a dif¬ 
ferent identification mark. This procedure may be feasible particularly in 
the case of residential universities and other universities having small num¬ 
ber of affiliated colleges. This malpractice can further be checked by put¬ 
ting centre pins to the answer books instead of side pins. While side pins 
can be put with a hand machine, it is not possible to pul centre pins without 
damaging the answer books. 

Tampering of centre pins leaves marks on the outer cover rendering il 
easy for detection at the time of despatch or valuation. Sometimes the 
candidates fasten the loose inner pages to the outer jacket with a tag. 
Such cases are easily detected. 
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The practice of putting up appeals to the valuer, candidates revealing 
the identity or enclosing currency notes, etc., can be curbed by issuing 
suitable warning to the candidates. The valuers should be instructed 
to report such cases whenever it comes to their notice. 

MASS COPYING AND CONSHOUENTIAL ACTION 

Mass copying may be with the connivance or in defiance of the 
authorities incharge of invigilation work at the centres. Mass copying 
with the connivance of the authoriticMS common in centres located in mofu- 
sal areas as there is a built-in safeguard in the form of lack of communi¬ 
cation. The reason for official connivance may be to get better results, 
to retain recognition, affiliation or grants received from the university or the 
government. It may also be due to the incompetence on the part of super¬ 
visory stair or the pressures or coercion exercised over them. Posting of 
outsiders as chief superintendents or deputy chief superintendents may go 
a long way in prcvcnling collusion between the candidates and the super¬ 
visory stair. Whenever such ca,ses are detected both candidates and the 
supervisory stair should he given examplary punishment to serve as a 
deterrent. Such cenires should also be declared disqualified for future 
c.xaminations. 

Ma.ss copying in defiance of the authorities calls for prior plan¬ 
ning. The authorities incharge of conducting examination should seek 
timely help from the District and Police authorities to put down such con¬ 
certed action by the candidates. Flying squards consisting ofuniversity 
authoritie.s may be sent to such centres to help the local authorities con¬ 
ducting the examinations. In all these cases there is need to give deterrent 
punishments to the guilty candidates. 

1'.NTAIR MEANS Al lTR THE r.XAMINATION 

Substitution of fre.sh answer book or insertion of fresh matter 
written outside the examination hall in the main answer book are the com¬ 
mon types of malpractices committed at the despatching stage. The chief 
superintendents should invariably check the .serial numbers of the main and 
additional answer books with reference to the entries in the invigilators diary 
before the books are de.spatched from ihcir centres to the university. Fur¬ 
ther. the despatch work should invariably be done in their presence. 

The candidate "chasing" their answer book.s constitute another 
kind of unfair means committed after the examination. The answer book 
bundles received from the examination centres .should be given to the des- 
palchers without mentioning the name of the centre and without giving any 
particulars of the register numbers of the answer books contained in the 
bundles. Before the answer books are despatched from the cenires they 
should be divided into hatches of 25 and should be sealed in cloth bags which 
ill turn should he sent in outer cloth bags. The despatchers in the univer¬ 
sity office should be instructed not to open the sealed inner bags but to send 
them to the valuer as per the scheme of distribution. The procedure pre¬ 
vents the despatchers from having any access to the answer books. The 
scheme of distribution of answer books should be kept confidential. The 
system of coding the answer books reduces scope of unfair means to a large 
extent, though it is a time consuming process. Another method of curbing 
such practices is to have centralised valuation with code numbers assigned to 
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the answer books. Proper selection of personnel for despatch, coding, 
tabulation coupled with eternal vigilance and supervisors at all levels goes a 
long way in reducing the cases of unfair means to the minimum. 

HEPORting of unfair means 

Procedure and proformae 

The unfair means ca.ses are detected : (i) at the time of examination, 
(/7) at the time of despatch of answer books by the chief superintendents] 
(ill) during valuation of answer books, and (iv) through other means, suth 
as petitions etc. 

In order to ensure uniformity in reporting unfair means ca.se.s. it is 
desirable to prescribe a procedure and to instruct the chief superintendents 
to follow the same. The procedure may be on the following lines: 

When the chief superintendent takes action against a candidate com¬ 
mitting malpractice he shall invariably demand a written explanation or 
statement of the candidate concerned in the presence of responsible wit¬ 
nesses. 

If the candidate refuses to give his statement, the candidate shall be 
asked to record in writing his refusal to give a statement. If he refuses to do 
even that, the fact shall be noted, duly witnessed by two members oflhe super¬ 
visory staff including the deputy chief .superintendent (where appointed). 

When a superintendent detects a case of malpractice, he shall send for 
the chief superintendent atonce. In the meantime he shall prevent Ihc 
candidate from writing further and shall not allow the candidate to remose, 
displace or destroy the materials from which the candidate was copyinp. 
Unless it is inevitable, he shall not take into possession such materials till 
the chief superintendent comes there. 

When a candidate is delected committing a malpractice, the superin¬ 
tendent who has detected the case and the chief superintendent shall lake 
care that their reports are always full and complete in every respect aniJ 
include all the known facts and relevant circumstances of the case and other 
evidence. Such reports shall be prepared in the prescribed proforma and sent 
to the controller of examinations by name by registered post alongwith the 
answer book and the concerned superintendent's' diary. The cover contain¬ 
ing the answer book and other documents shall be superscribed ‘Stray Answer 
Book’ in block capitals. 

Detection of malpractice at the stage of checking and despatching of answer 
books—procedure to be adopted 

Should a suspicion arise at the time of checking and despatching of 
answer books with regard to any particular answer book, the chief superin¬ 
tendent should send that to the university stating the grounds of suspicion 
alongwith the statement of the room superintendent who noticed the cases. 

Detection of unfair means cases at the time of valuation—procedure to he 
followed 

The valuers of answer books should be suitably instructed in advance to 
report to the controller of examinations all suspected cases of unfair means. 
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They should send such answer books separately as stray answer books along- 
with their reports containing grounds for suspicion. The cases in which the 
candidates insert pages with matter written outside the hall, cases of reveal¬ 
ing the identity and cases of putting up an appeal to give pass marks come 
under this category. 

Inquiry into unfair means cases by the university—procedure to be adopted 

At the university level a syndicate committee designated as unfair 
means inquiry committee goes into all cases of unfair means reported by the 
chief superintendents, valuers and others. All the cases received are review¬ 
ed by the committee and charges are framed in fit cases. The charge sheets 
are .sent to the candidates at their permanent address directing them to ap¬ 
pear before the committee to defend themselves against the charges. They 
are permitted to look, inlo the connected records and to put forward their 
defence, if any. As a general rule the candidates are not usually permitted 
to engage counsels. The proceedings of the unfair means inquiry committee 
arc quasi-judicial in nature and the candidate is, therefore entitled for an 
opportunity to adduce evidence in his support and to cross-examine the wit- 
nc.sses deposing against him. He is also entitled to a copy of the records 
on which the charges are framed and to a copy of the decision containing 
the reasons. The decision of the c.)mmittec is subject to judicial review. 

Ol'SNTLM OF Pt NISIIMC.NT 

The quantum of punishment in unfair means cases depends upon the 
gravity of the malpractice committed by the candidate. In cases such as 
impersonation, the candidate is punishable both under the rules framed by 
the university and under the provisions of Indian Penal Code. The usual 
mode of punishment is to debar the candidate from appearing for the uni¬ 
versity examinations for varying terms depending upon the nature of the 
malpractice commiited by him. In less serious cases, the erring candidates 
are warned or admonished by the university. There is need to give deter¬ 
rent punishment in cases involving deliberate planning to commit malprac¬ 
tice at the examination. 

For determining the quantum of punishment the following guidelines 
may be kept in view : 

The cases in which the candidate has in possession papers, books or 
notes, which are of possible help to him or ca.ses in which he is found giving 
or receiving assistance or copying from paper, book or note or allowing any 
other candidate to copy from his answer book and cases of disclosing the 
identity in making specific marks in answer books, may be put in the first 
category. Candidates indulging in such malpractices may be debarred from 
appearing for an university examination for a period not exceeding two years. 
Cases in which the candidate makes deliberate previous arrangement to 
cheat in the examination, such as smuggling in another answer book, imper¬ 
sonation, misconduct, etc., may be put in the second category and the candi¬ 
date may be debarred for a period of not exceeding five years. 
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'Jn:air 1/^eans at examinations 


V. G. PATHAK 


MASS COPYING 

In order to eliminate the use of unfair means in examinaiion, we have first 
to see the manner in which the corrupt practices arc adopted during exami¬ 
nations. The most common practice adopted is copying from books or notes 
individually in the examination hall. If copying by individual candidates 
is not checked by proper invigilaiion, the copying material is passed on from 
one candidate to the other, and ultimately, it assumes the magnitude of mass 
copying by almost one and all in the examination hall. Recently a tendency 
has been ob.served on the part of examinees to abuse and threaten the iinip- 
lators with violence if they try to check such practices. If the invigilattirs, 
the officer-in-charge of the examination centres, yield to such threat, s. the 
examinees establish their right of copying by force and it becomc.s an opiin 
secret that copying is allowed at a particular centre of examinaiion, The 
enrolment of such colleges rises suddenly and even tho.se persons, who are 
not even anxious and sincere to their studies, get themselves enrolled in such 
colleges, in order to get through the examination by resorting to copying in 
the examination hall. 

It is also seen that even some principals, in order to popularise their 
colleges, give encouragement to such copying at their centres. There arc 
instances when principals have kept the entrance of examination centres 
locked or guarded, so that the inmates, who might be busy in mass copying- 
be informed about the visit of any university authority or of the inspection 
committee or of the flying squad. 

The menace of mass copying has grown so strong at certain places lhal 
even the universities fail to take proper and adequate steps to put an end m 
it. It is better to close the universities or colleges than to allow such typ‘ 
of mass copying with open eyes. The reluctance or indilference to 



copying by the teachers, invigilators, principals and university authorities, 
is a great setback and challenge to the educational system the society has 
adopted for its nourishment and growth. One of the probable reasons for 
such indifference on the part of universities might be the fear of students 
unrest in general at the time of examinations which creates hindrance in the 
conduct of examinations as a whole. Sometimes there are pressures from 
nolitical quarters not to disturb peace at any cost and therefore universities 
hesitate to take proper steps to put an end to the evil of mass copying. 

It is now high time for the Central and State Governments to intervene 
and to take proper steps to check the corrupt practices by taking the univer¬ 
sity authorities into full confidence. Proper interest, directives and help 
hy Government can improve the situation greatly. After all, the persons 
u'ho create nuisance in the examination hall arc a few and if they are con¬ 
trolled the menace of mass copying can be nipped in the bud. Ph-oper 
police protection should be assured at all examination centres without any 
hciiiation and, whenever a report of mass copying is made, proper enquiries 
should be made and the whole examination of that centre should be cancel- 
ilcd forthwith to stop recurrence in future. 

.StAIR MEANS DY VALL’LMS 

Anolher type of unfair means is sometimes adopted by the influential 
,'alucrs. They arc unfortunately sonic of the so called educationists, profes- 
,or> or heads of the dcparlmcnis in the universities and colleges, who are 
lot true lo their profession and get the valuation work done through their 
igents and thus reduce the valuation w'ork to one of the methods of making 
noney. They arc not so much conscious about correct valuation as they arc 
tmscious about getting the examinership from various sources. These 
ersons arc in such a high position that they get the teachers of their choice 
1 the university and colleges appointed as examiners. They arc also guides 
fabout a dozen of research wokers. Being on the bodies of other univer- 
ilics. (hey arc in a position of exchanging the examinership with their own 
'roihcr universities. In return of this favour they get the valuation work 
Hotted to them done by their favourite teachers and research workers, 
he purpose of the university to appoint good and experienced teachers as 
3luer.s. is thus defeated. In certain universities, there are restrictions that a 
agle examiner should not get more than a specilled amount of remune- 
-tion for a single examination session, but this does not take into account 
'e remuneration received from other universities. Thus, on the one hand, 
lese professors earn thousands of rupees by way of remuneration, and on 
e other, they do not value the answer scripts sent to them for valuation. 
|cause they distribute the answer books to various persons, their standard 
Valuation also differs. One cannot believe that these agents might be 
Juing the answer scripts scrupulously. Thus the valuation becomes a 
me of chance. It is more harmful to good students whose answers might 
'I have been valued by some agents by paying required attention towards 
^ contents. Adequate measures should therefore be taken to stop this 
'Bency system" and the "academic dishonesty". The professors of uni- 
fjities in general can be made examiners for research papers, thesis, etc. 
Q the examinership of other popular subjects of postgraduate and under- 
tduaie level can be bestowed upon the senior and experienced teachers of 
■ lower ladder like readers, asstt. professors, lecturers, etc. 
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take much interest in individual students. In order to make themselves 
popular among students, they even support their illegitimate demands, 
and bring all sort of pressures on the university authorities to yield to 
their demands and thus lot of confusion is created about the examinations 
and results of examinations. This confusion is further enlarged as a result 
of the mal-administration of the university. Care must, therefore, be taken 
to see that no unjust demand of examinees is met at any cost and unreason¬ 
able interference from any quarter should be met with strong hand. The 
universities should maintain the sanctity of examinations above all sorts 
of feuds, groupisms and politics in university administration. 

CONCLUSION 

It is painful to note that at times the university examination results 
are not so much trusted by some institutions and they hold separate en¬ 
trance exaininutiuns for admission to their respective course of studies, 
like the Pre-Medcal Test Examination. There might be other reasons for 
this, but one of the reasons is the doubtful nature of the examination and 
examination results. Some persons speak of the outdatedness of the exami¬ 
nation system and its need for improvement. Some feel that books may 
be allowed in examinatiun halls and the pattern of questions be so changed 
that the examinees may not be able to copy word by word directly from the 
books. Whatsoever useful the.se suggestions might be, these are not the 
remedies for stopping the use of unfair means. Whatever may be the mode 
of examination and whatsoescr improvements are made therein, a student 
who has not studied the subjeet properly will need help from other sources 
in the examination hall and will insist that he be allowed to do so without 
any hindrance. Therefore the use of unfair means can best be cheeked only 
bj'a determination on the part of all concerned to slop it, by proper invigi- 
laiion in examination hall by proper police protection, if need be, and by 
proper administratisc reforms to cement all sources of leakages. Testing 
Ufa product is as important as its production and a seal of standardization 
on it should speak of its quality. The degrees and diplomas awarded by 
universities should be the true indicators of the abifties and profic.encies 
of persons holding them. 
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1 (Measures :or Cliecking the 
■Jse 0 - 'Jniair '^^eans 

JAGJIT SINGH 


To THE PEOPLE who have to conduct the examinations I would say that the 
belts must be tightened and the potentialities of the following measures may 
be explored: 

1. Good examination halls with all amenities and reasonably com¬ 
fortable furniture is indispensable and will go a long way in improv¬ 
ing the situation. 

2. Mature persons with keen sense of responsibility should be appoint¬ 
ed for conduct and invigilation duties. 

3. A detailed inventory of unfair means should be prepared and res¬ 
pective punishments accruing as a result'thereof be spelled out. 
Every candidate should be asked to sign such a list at the lime of 
submitting the admission form. Such an undertaking should be 
got signed by the candidate and his guardian that they may be un¬ 
able to take recourse to law. This undertaking should be formu¬ 
lated by legal experts and should be incorporated in the university 
Act. The legal provision in university Act will countervail all 
other laws to which the defaulters take recourse to. 

4. Whenever cases of unfair means are reported on a well conceived 
and comprehensive proforma, action should be taken 
immediately. 

5. Remuneration for invigilation duties should be adequate so as 
to attract people of a better calibre. 

6. Of late the National Council of Educational Research and Train¬ 
ing has been holding Paper-Setters Workshop to train paper- 
setters. It may be considered if some sort of training be given to 
those who are involved in the conduct of examinations. 

7. The principals should be entrusted with overall responsibility for 



smooth conduct of examinations in their colleges and maintenance 
of discipline outside the examination hall/halls. They may fui' 
ther be authorised to enter the examination centre if and when the 
situation so demands. 

8. No centre should have a strength of more than 2S0 candidates as 
far as possible. Before a place is cho.sen for an examination 
centre its capacity should be carefully examined and the seating 
arrangement made in such a manner that candidates are not seated 
in close proximity. This will ensure better invigilation and less 
scope for candidates to employ unfair means. 

9. The strength of the supervisory staff be determined at the rate of 
one invigilator for every 30-40 candidates. In centres where rooms 
are used a minimum of one supervisor irrespective of the num¬ 
ber must be there even if the number of students seated as per 
capacity of room is less than 40. If the number exceeds 40 in a 
room another invigilator be appointed. 

10. One special assistant superintendent be appointed for supervisory 
duty outside the examination hall who may be required to keep 
strict vigilance on the urinals when students go to urinate. 

11. To minimise the use of unfair means the students must be educated 
in the college not to resort to the use of unfair means and they be 
apprised of the consequences and its effect on their future life. It 
will be advisable in my opinion to apply these rules in the House 
Tests. A rule that the students detected using unfair means at the 
House Examinations will not be allowed admission to the univer¬ 
sity e.xaminations may be made. That may have some deterrent 
effect. 

12. No books or papers be allowed to be placed inside the examination 
hall or room. To discourage the use of unfair means it may be 
considered worthwhile if the students are asked to dispossess 
themselves of any type of books or papers before they are allowed to 
enter the examination hall. 

13. Due protection should be proxided to the supervisory staff in 
consultalioii with the District Magistrate of the illaqa. 

14. All the examinaiion centres should be listed into three categories 
r/a.. g(’od saiisfaciorx and indiffereni and these lists should be cir¬ 
culated so as to make the iiidilferenl ones feel and realise their res- 
ponsibilitx. 

15. Experience shows that the presence of police serves as a red rag to 
a bull. The student community somehow is allergic to it. Instead 
of police it will be better if some influential persons of the com¬ 
munity arc taken into confidence. It may yield good results. 
After all. unfiiir means is a society question. If this exercise starts 
in the formative period of the life of the youth, there is no reason 
to believe that they will not be using these third degree methods 
in their profession and life, when they leave the portals of education¬ 
al institutions. 

16. In order to keep off outside interference at the examination centres, 
the district authorities should be approached to promulgate 
Section 144 within the radius of 100 yards of a notorious centre. 
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This of course should be Ihc last resort where other [remedial 
measures fail. 

INSPECTION OF CENTRES 

1. The inspections must be conducted on the days of compulsory 
papers. The inspectors should remain at the centres throughout the exami¬ 
nation of these days. If a candidate is unable to use unfair means on the 
days of compulsory papers he might not make any attempt in other subjects 
as it may not be helpful. 2. The inspections should be made frequent speci- 
cially in case of notorious centres, .t. For notorious centres besides the 
usual inspection, flying squads may also be appoimed. 

In the end I would like to agree with the extremists view that either end 
the system and abolish all examinations or mend them with the tenacity 
of purpose to relieve us of this widely spreading pestilence of unfair means. 
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Co.'ective Use o:' Un'air Means 

GIRIRAJ KISHORE 


THF COLLECnVt USE OF UNFAIR MEANS 

The KANPUR iNi'ERSiTY may appropriately be quoted as an example 
in this connection. After the tri-furcation of the Agra University, the Kan¬ 
pur University conducted its first examination in 1968. From 1968 to 1970 
the university experienced that the use of unfair means at the individual 
level has increased in number (Enel. I .). In 1970 this tendency has 
turned into collective use of unfair means. In reference of the collective 
ii.se of unfair means, the examination of 1970 conducted by the Kanpur 
University can be considered as an important examination in its history. 
The vice-chancellor of the university made real efforts to curb this practice 
of the use of unfair means at the university examinations and appointed 
senior and impartial teachers of the colleges under the unis ersity in a large 
number to inspect the examination centres. The determination ol the 
wce-chancellor and the efforts of the inspectors brought four centres f.e., 
1. Badri Vishal Degree College, Farrukhabad: 2. D. N. Degree College, 
Fatehgarh; 3, D, S. N. Degree College, Unnao; and 4, Feroz Gandhi College, 
Rai-Bareli to book under the charge of mass copying. 

The Act and Ordinances of the university were completely silent on the 
point of collective use of unfair means. The present Ordinance 
could only treat the cases of unfair means at the individual level. Moreover, 
there was no precedence before the Executive Council as a guide-line against 
the collective use of unfair means by the students. In the absence of any 
light shown by the Ordinances or precedent the Executive Council took cer¬ 
tain decision against the above mentioned four centres; 

I. AJl the four examination centres were abolished for a period 
of three years. 



2. All the teachers of the four colleges were debarred from remuner¬ 
ation work of the university for a period of three years. 

3. No further affiliation for new subjects be granted to these four col¬ 
leges, for three years. 

4. All examinations conducted at the above four centres be cancelled 
and fresh examinations be held by the university. 

Consequently the re-examinations were to be held from ISlh July, I97U, 
the students were informed through registered letters. Since the Act was 
silent and no Ordinance was available on this point, the students, guardians, 
political communities represented to the Chancellor. The Chancellor inter¬ 
vened at a very' late stage and advised the Executive Council not to hold re¬ 
examinations. 

SUGGESTIONS TO CHECK MASS COPYING 

Till there is improvement in the present system of examination, the 
measures to check the tendency of mass copying at the following three levels 
are suggested : 

A. Constitutional Level. 

B. Operational Level. 

C. At the Level of Examination. 

A. (0 The limitations of the universities at the constitutional level had 
already been discussed. The universities generally meet such situations b\ 
framing the Ordinances under the provision of Act and Statute. The fram¬ 
ing of the Ordinances and its operation have their own limitations. The 
problems involved in mass copying arc becoming grave and the conduct of 
examinations under present system is becoming diflicult. Hence the col¬ 
lective use of unfair means at the examination centres should clearly be de¬ 
fined in the Act itself. 

(h) The powers of the vice-chancellor, defined under the uni\er.sity .Act 
should be amended and this be added that if the vice-chancellor is satis- 
filed through the report of the centre inspector or through the inspection 
made by himself that the use of unfair means at a particular centre is more 
than 25%, he may cancel the examinaiions held at that centre immcdiaiclv 
and report to the Executive Council. Incase the v ice-chancellor desires to 
inflict severe punishment, he may place his recommendations before the 
Executive Council. 

(ii7) There must be some provision about the special powers of the 
vice-chancellor during the examinations of the university under the Act. 
The vice-chancellor may call the district administration at any time in the 
wake of emergency connected with the university examinations. The dis¬ 
trict administration should immediately respond to his call. 

(iv) If the vice-chancellor finds the sanctity of the examination is being 
vitiated, he may recommend for the requisition of buildings connected 
with the Government private or social organisation to the district authorties 
for the conduct of the examinations. The district administration should 
fully co-operate with the vice-chancellor. 

B. (i) For the smooth conduct of the examinations, special grants 
should ^ given to the universities to construct the examination hall. Ip 
case of affiliating universities, the examination halls will be needed at every 
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district headquarters under its Jurisdiction. Special grant will also be re¬ 
quired for the equipment of the examination halls. 

(ii) There should be provision of a permanent inspectorate in the 
university. In the absence of the permanent inspectorate the problem of 
inspection in an affiliating university becomes very acute. The teachers 
of one college are sent to other colleges for inspection and there is always 
a possibility of their being influenced at personal level. Hence, the provi¬ 
sion of appointing a permanent inspectorate should immediately be consider¬ 
ed at the Government level. 


(Hi) Police flying squads should be provided to the board of inspectors 
during the inspection of the examination centres and they should also be 
given powers of first class magistrate by the State Government. The 
board or the members of the board will exercise these powers in maintain¬ 
ing the .security of the university examinations. 

(;i ) In case the board ol'lhc inspectors or its members find an individual 
copying or the collective use of unfair means at a centre, they can remove the 
invigilator or invigilators immediately from the invigilation duty and report 
to the university for debarring him or them for a certain period from re¬ 
munerative work of the university. The university will also have the right 
to punish these invigilators through the managing committee. 

C. Till the of system internal assessment is introduced, it is necessary, 
to consider the measures to remove the possibilities ofusing unfair means 
before and after the examinations from the present syste.-n of external assess¬ 


ment- 


(i) Syllabii should be detailed with the names of the books and the 
journals against the topic prescribed in the syllabus. The marking scheme 
should be such that the possibility of excluding any topic at the time of pre¬ 
paration by an examinee can be minimised. The questions in a question 
paper should be set topic-wise. 

(ii) The present mode of setting a question paper needs a change. No 
question in a paper should take more than 10 minutes to answer. The num¬ 
ber of questions to be attempted should be raised four times from the pre¬ 
sent number of questions in a question paper. Under these conditions, 
if possible, the students may be allowed to bring with them the text books 
only in the examination hall for consultation. 

(Hi) Like the ancient system of Indian education the major part of the 
examination should be made oral and the board of the examiners for craduct 
ing the oral examinations should consist of four teachers from dinerent 
universities. 


(If) Parliament may be approached to frame an Act to ban writing, 
printing and using of cheap notes and guess papers. During the special 
screening of answer books of four centres of Kanpur University, it was 
found that nearly 70^ students used cheap notes and guess papers in the 
examination hall. 

(I'J The centre superintendent must have th' right to undertake physical 
search of students if he suspects the sanctity of the examination is being 
violated during the university examinations. 

(vi) There should be a provision of campus police in the universities 
which will help the examination sujerjntendent and the invigilators m con¬ 
ducting the examinations smooth y. It will also be easy or 
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superintendent to conduct the physical search of student w th the help of 
campus police. The campus police will also help in restraining the students 
from taking the law in their hands. 

(v/i) This has also been experienced that the students are in the habit 
of using unfair means after appearing in the examination, by approaching 
the examiners. They also try to know their result before hand by approach¬ 
ing the tabulators. The following suggestions are being proposed to check 
this tendency of using unfair means at post examination stage: 

(a) CoJing : The system of allotting the code numbers in all examina¬ 
tions should be introduced in the universities. The universities should be 
given special grants for establishing coding cells. The personnel for this 
work should be technically trained. The University Grants Commission 
should arrange to establish an Institute for imparting such training to t' e 
university personnel, as may be beneficial for the smooth and efficient 
working of the coding cells. 

(b) L'aUialion : The answer books of the examinees should be centrally 
evaluated under the supervision of the university. The practice of sending 
the answer books to the examiners needs to be stopped. This will help in 
putting off the tendency of approaching the teachers at the post examination 
stage. 

(c) A/flr/tmg ij//l/uiivr SooA j : To stop erratic marking, at least at post¬ 
graduate level, b\ an outside examiner, the answer books should be evaluat¬ 
ed by a set of two or three examiners and the result shoulJ be declared on the 
basis of the minimum average marks obtained by the examinee. 

(d) Mechahisation : The whole processing after the csaluation of llie 
answer books should be mechani.sed. This will help in checking the tendency 
of improving or changing the results at the tabulation stage. 

It is bored these observations will be taken in the spirit in which they 
are given. We are faced with a serious problem and unlciis drastic measures 
are taken and pretty quickly to stern the rot that has set in. the whole struc¬ 
ture of our educational system may collapse. 
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Prevention o: 'Jniair '/?eans 
at tile Pxaminations 

V, M. SUD 


In ORDtR TO curb the e\il. not only punitive but also preventive measures 
would be necessary. The m 'st imporLint of these steps could be to attract 
teachers of integrity for the supervisory jobs. Teachers of iitegrity, who at 
present try to avoid being involved in supervisory work in spite of tempting 
remuneration, would be forthcoming in adequate numbers as soon as they 
can be assured of their personal safely. Police protection would not prove to 
be enough, .4 concrete step to provide the necc sary security is to cover tli’in 
by insurance against risks. There exists a plan of general assurance under 
which by paying a premium of about Rs. 5, • per year a person is insured for 
Rs. 1000/- against death. Under the same insurance I e is entitled to some 
benefits for loss of limb. He is also provided Iwspitalizaiion charges and 
medical expenses in case he sustains temporary injuries. To make it a real 
insurance cover, every member of the supervisory stall’ should be insured for 
Rs. 10,000/- and the premium therefor, which would come to about Rs. 50,- 
per head per year, must be paid by the university. It is not going to prove 
to be a great financial burden on a university. Assuming that an examina¬ 
tion continues tor about 40 days for annual examination and another 20 
days for the supplementary examination. i.i\, 60 days in all, a person will 
get a remuneration of Rs. 480/- calculated @ Rs. 8;- per session, which is 
the rate prevalent at our university. It would amount to only 10“^ of the 
remuneration which would be more attractive than to give a arise of 20% 
in the remuneration and make it Rs. IC/- per session. 

Besides the insurance cover, the university or the college, as 
the teacher is employed in the former or the latter, couU also cxten l 
the benefits of the bonus schemes, in the event of death of an employee on 
examination duty. Most of the universities and the colleges have a bonus 
scheme, for payment on retirement or death, whichever is earlier, but this 
benefit is available only to those employees who have pul in a specific num¬ 
ber of years of service. This condition may be waived in case of death 



while on examination duty and the minimum amount of bonus payable be 
fixed. 

Adequate police protection during the actual conduct of the examina¬ 
tion is also essential. The police force at each centre should be adequate, 
keeping in view the local conditions. It should preferably be from a differ¬ 
ent station so that it is not pro e to local influence. It should be under the 
control of the centre superintendent. The area surrounding the examination 
centre should be declared out of bounds for all persons, except the examinees 
for the day, the supervisory staff and those who are specially authorized to 
visit the centre for inspection, etc. similarly, no member of the supervisory 
staff should, except in an emergency and under the superintendent’s written 
authority, be permitted to go out during the examination hours, to rule out 
the possibility of external communication in any form. To enforce this, 
(here should be surprise visits not only by superior police officers but by 
university officers also. 

To ensure effective supervision in.side the centre, there should be an 
adequate number of supervisors. In case of big balls, the ratio should not 
exceed 1:30. In case of smaller rooms, there should be at least two super¬ 
visors per room whatever the number of examinees in that room. 

At the beginning of the examination each day, the centre superinten¬ 
dents are generally expected to read out a long list of directions to the can¬ 
didates. In actual practice, however, this is never done except on the 
first day. It is therefore deirable to draw up a smaller list and to ensure 
lhat it is read out each day by the supervisor concerned before the question 
paper is distributed. It would include the following: 

(1) No candidate should have in his possession or accessible to him, 
any papers or notes written on his desk, instruments, body, cloth¬ 
ing etc. (This will rule out the plea of inadvertence subsequently), 

(2) All candidates must write their roll numbers on the question 
paper and the blotting paper, but no question or answer thereto 
should be written on these. (After this is done, these papers can¬ 
not be exchanged by the candidates). 

(J) All candidates must write their roll numbers on the answer books 
and each of the continuation sheets issued to them, before they 
start writing on them. (This will also make it difficult for these 
to be exchanged between the candidates or to be smuggled out 
for use on a later date.) 

(4) No candidate should bring in any eatable in the hall. In case any 
one has to chew or swallow medicine, he must seek prior permis¬ 
sion of the supervisor incharge. (In some cases, candidates 
take the plea of swallowing medicines, while actually they swallow 
incriminating malerial). 

It should be one of the specific duties of the supervisors to see, soon 
after the distribution of the question paper, that the candidate has written 
the correct roll number on the answer book. He will also ensure this while 
issuing any further continuation sheets. If any omission or mistake is 
found during a surprise check in the centre or when these have been sent 
lo the registrar's office, a penalty @ Re. 1/- should be deducted from the 
remuneration of the supervisor. 

The answer books and the continuation sheets should be stamped dur¬ 
ing the examination hours, when these are being written upon by the candi- 
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dates. The rubber stamps should be serial numbered and a record of the 
serial number used in a particular row on a particular day should be main¬ 
tained by the centre superintendent. With this it will be possible to detect 
any case where a candidate tries to smuggle in a continuation sheet on a 
subsequent day because the stamp number would invariably differ. 

At the close of the examination, the supervisor incharge should account 
for not only the number of answer books issued by him to the candidates 
but also for the continuation sheets. The number consumed as per the sig¬ 
nature chart should tally with those actually used and handed over to the 
centre superintendent for onward transmission to the university, [f an\ 
candidate has taken out any continuation sheet, the defaulter will atonce 
be located. 

The supervisors should also maintain account of the examinees going 
to the urinals and get the latter's signatures, in order to curb the possibility 
of going to the urinals frequently, with a view to consulting notes, etc. 

But inspile of all these precautionary measures, it will be difticiili 
to exclude all cases of use of unfair means. The .supervisors will therefore 
have to be very vigilant and as soon as a case comes to their notice it will 
atonce be reported to the centre superintendent. The incriminating 
material, as also the answer book with the candidate shall be taken possession 
of and the candidate shall be supplied with a fresh an.swcr book and per¬ 
mitted to continue with the examination at a separate place under the 
supervision of the centre superintendent. He will be asked to make a 
statement at the close of the examination but if he refuses to make a state¬ 
ment, he should not be pressed and the fact should be mentioned while re¬ 
porting the case to the university. In all cases, the centre superintendent 
will mark in the first answer book the place at which the case was detected. 
This will be useful later on when the case is being enquired into by the uni¬ 
versity authorities. 

Cases of use of unfair means should be reported by the centre superin¬ 
tendent at the end of the examination, while forwarding the examination 
answer books. The proforma generally prescribed for reporting these cases 
IS a lengthy one, making it difficult for the centre superintendent to fill it 
completely for lack of sufficient time. It is therefore e.ssential that it should be 
brief but at the same time it should incorporate all the necessary information. 

Now coming to the punitive measures, the various types of unfair means 
which the candidates adopt in connection with the examinations could be 
broadly classified as under; 

I. Approaching an Examiner or the Registrar 
—to influence in the award of marks 

II. Previous deliberate arrangement to cheat in the examination 

Under this heading could come a large number of olTences, some of 
them of a minor nature and the others of a very grave nature. For example, 
writing of some material with a view to bringing it into the examination 

writing a wrong roll number or changing sheets with another candidate 
are a part of the previous deliberate arrangements made by a candidate 
to cheat in the examination, but more serious offences are to smuggle out an 
answer book or a continuation sheet for use on a subsequent day or imper¬ 
sonating for another candidate or leaving the hall without delivering the 
answer books to the supervisor incharge. 
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III. Cheating during the examination 

These are usually with a view to making use of some written material 
which had been smuggled into the hall by the candidate himself or copying 
from another person’s answer book or permitting somebody else to copy, 
bqually serious would be the consulting of incriminating material or talking 
to another person in the examination hall or in the urinal or while going to 
the urinal or coming therefrom, writing of questions on the blotting paper 
or anyother paper in the hall with a view to passing them out and subse¬ 
quently, getting answers thereto, or writing of answers to questions on the 
question papers or blotting papers or any other paper in the hall with a 
view to passing them on to some other candidate. 


IV. Indiscipline 

Disobeying the centre superintendent, misbehaving towards the 
supervisory stall in the hall or after the examination is over, swallowing 
or destroying the incriminating material when detected: this category of 
offences would need to be taken note of most seriously. 

The quantum of punishment for the various offences would vary from 
offence to offence. The general spirit behind punishment should be not to 
mar the career of the student for just a folly committed by him. In fact 
in every such case, it is not so much the candidate alone who suffers, but the 
parents' also do. But still the punishment should be so as to become a deter¬ 
rent for the candidate or for others to commit such an offence. Taken 
lightly, there is every danger of their providing encouragement to others— 
even the innocent ones, There may be difference of opinion as regards the 
quantum of punishment for the various offences. 

After the cases of unfair means arc reported by the centre superinten¬ 
dent, these are required to be considered by standing committees, appoint¬ 
ed by the appropriate body of the university, in our case the Academic 
Council. The committee usually comprises 8 to 10 members and they are 
expected to go through all the records of the case, to hear the candidate and 
then to take a decision. The committee is of a quasi-judicial nature and 
it is their duty to see that the rules of natural justice are complied with be¬ 
fore they finally decide a case, because these days writs against the cases 
decided by these committees in the High Courts are not uncommon. It 
is, however, difficult for the committees to hear each candidate and to find out 
the facts, to record his statement etc. It is therefore usually left for the 
asstt. registrar concerned to hold a preliminary hearing at which the candi¬ 
date is confronted with the allegations against him and he is shown the rele¬ 
vant record. The candidate is then required to make his statement in the 
form of answers to a questionnaire. This statement of the candidate is 
placed before the committee when they consider the case. The candidates 
have also the option to appear before the committee. The committee 
after hearing the candidate and referring to the relevant records is expected 
to record their decisions in the form of what the High Courts require to 
be a ’Speaking Order’. Bv this it is meant that the committee is expected 
to consider each and every^ plea taken by the candidate and give reasons 
why they have decided no't to accept it. Whai is important is to show 
that they have really done justice. 
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I have in the foregoing pages tried to deal with some of the aspects 
of the cases of use of unfair means at the university examinations. These 
are not expected to bring about an ideal situation, where there would be no 
such cases. This perhaps mi>ht be possible only if we change the entire 
system of our examination, but that will be waiting for that ‘ideal day’, 
which may take too long to come. 



J.ying Squacs :or Universities 

V. N. KHANNA 


Till we have some radical changes in our methods for imparting education 
in our colleges, the present system of examinations' is a must. This is per¬ 
haps the only instrument available for measuring the depth of knowledge 
of the students. The Education Commission has also realized that the 
external examinations will remain with us for a long time specially in univer¬ 
sities which have large number of affiliated colleges ^of unequal standard. 

In order to ensure that the said instrument, that is the system of exami¬ 
nations, gives correct results about the depth of knowledge of the examinees, 
it is necessary that there should be proper arrangements for invigilation 
by responsible persons; the students who are required to take examinations 
do so under the same conditions and what the students write in the exami¬ 
nation hall is their own. Under this system if a student is provided some 
‘guidance’ or ‘aid’ in the examination hall in any form we will not get a true 
picture of educational attainments. With such 'aids' which we call ‘use of 
unfair means', a student who has not been regular in attending classes and 
who has not given satisfactory performance in the class room will give better 
result, in comparison to a student who has been throughout cellar in his 
studies. The result is just opposite, the ‘instrument' fails to provide depend¬ 
able and real information due to manoeuvring by the examinee himself. A 
student who passes examination by using unfair means has no knowledge 
of his own and at the same time he also spoils his character. But in the p^^ 
sent set up he has belter market value for the purposes of employment. 
The product labelled as ‘A class’ on the basis of the reading given by the 
testing instrument is not only adulterated but away from purity. 

It is evident that the present system of examinations cannot be regarded 
as a real dependable means for gradation of the students unless we are sure 
that the invigilators deputed have a control over the examinees and there 
is no use of unfairmeans. Keeping in view the performance of duties by 



the invigilators wc may classify them in the following 4 categories;— 

CAIEGORY ‘a" 

This includes the invigilator^ whoperform their duties sincerely and who 
would not allow any examinee to use unfair means. They keep a careful 
watch and arc vigilant like a Jawan on a border post. 1hey will not hesitate 
to take action against so called students’ leaders and the students having 
connections with V.l.P.s. But unfortunately in the present environment of 
the country they are a sufl'erer. They are threatened, assaulted and even 
killed. 

Category b" 

This includes the invigilators who perform their duties to the extent that 
they will nut take any action if defaulting examinee has affiliation with some 
V.T.P. or is a ring leader. They will, however, have no reluctance in report¬ 
ing the cases of the examinees who in their own opinion cannot put any harm 
to them. 

category C 

This includes the invigilators who have decided to follow the policy 
'see no evil’ and they turn their back whenever they find an examinee using 
unfair means. They would advise the examinees to keep silence and would 
themselves stand either at the gate of examination hall or will read news¬ 
paper or some magazine. 

category ‘n’ 

This includes the invigilators who have not proved to be good teachers 
and who are unable to impress the students with their knowledge in the class 
room. In certain cases some of the teachers belonging to this class may 
have themselves resorted to use of unfair means when they were examinees. 
In order to gain cheap popularity the teachers belonging to this class freely 
move with the students and sometime give them a hint that they will help 
them at the time of examinations. These teachers when deputed a.s invigi¬ 
lators create a lot of problems. Since most of the invigilators belonging to 
this class have connections with V.l.P.s and students' leaders, the authori¬ 
ties cannot dare to take any action against them. 

There has been a mushroom growth of colleges in the country during 
the post-independence era. New colleges are opened despite the fact thal 
they are unable to fulfil the conditions and the things are much below the 
standard. Our leaders in their scramble for self power and position need a 
large number of assistants and followers, which also include undesirable 
elements. In fact our leaders and their assistants are responsible to a great 
extent for the pollution of the atmo.sphcrc in our colleges. They put in¬ 
fluence for opening of a college as they want to make use of it for their 
strategy. They exert influence at every point. The selections of teachers 
are made on their recommendations. Undesirable students are admitted 
at their instance. And now they al.so put undue influence at the time of 
examinations. Due to this influence of politicians and their associates a 
large number of teachers are willingly or unwillingly migrating from cate¬ 
gory of invigilators classified by me under ‘A’ to the category classified as 
‘C’. 
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Under the conditions prevailing in our colleges the schemes like periodic 
assessment and semester examinations will not be able to make any improve¬ 
ment. The teacher who has to a.sscss the students, the teacher who has to 
invigilate has to face hindrances in performance of his duties. 

To deal with the problems of use of unfair means, the Agra University 
introduced the scheme of inspection of examination centres by flying 
■ quads. This was the first experiment of this type in the country. Of 
course, this is a short term mea.sure but this has given encouraging results. 

The aim is to control mass-copying and eliminate use of unfair means 
during the examinations of the university. The colleges affiliated to he 
Agra University were divided into two zones. One : Agra-Aligarh-Mathura 
Zone and the other Bareilly-Moradabad Zone. In all nine squads were 
constituted by the university for the purpose. Each squad had 5-6 teachers 
with one of the senior teachers as its leader. They were provided with 
laxies and were advised to secure the help of local police authorities before 
making the ‘raids’ at the examination centres. Under the protection of 
local police searches were made of ihe examinees and the cases of the candi- 
ates detected using unfair means were reported to the university. The 
assistance and cooperation received fmm the police authorities was very 
encouraging and worth admiration. 

The flying squads of the university rendered useful service in the 
direction of the smooth conduct of the university examinations. With the 
implementation of the scheme, there has definitely been a check in the use 
of unfair means. On the other hand it has rai.sed the morale of the invigilat¬ 
ing staff. More than 1000 candidates were detected using unfair means at 
the examinations of 197(1. 

The total expenditure on this scheme was near about Rs. 12.000;-and 
the State Government is being requested to contribute for the purpose. 

I personally feel that following factors are responsible for the successful 
implementation of the scheme: 

1 . At the time of the ‘raid’ there should be adequate police force for 
ihe security of the members of the squad. It must be ensured 
that with the help of police, proper control will be maintained 
over the undesirable elements. 

2. The members of the squad constituted must be bold and should 
have some exijerience of dealing with problems of the students. 
Th-y should b:; able to take quick decision i i case of emergency. 

3. In case there is no adequate police protection and the members 
of the squad feel that they have to face some untoward incident 
they should not make any ’raid’ and should just have a ceremonial 
inspection and plan a ‘raid’ for some other date. 

4. The programme of the ‘raids' should be strictly confidential and 
the raid should be sudden without any formal or informal notice 
to Jhe authorities of the centre. 

In order to root out the evil, 1 feel that there should be a central scheme 
for such flying squads. Till such scheme comes iito existence the U.G.C. 
.should create a fund for providing financial assistance at least of a sum of 
Rs- 50,000/- to the families of teachers who may be killed only on account 
of the fact that they had performed their duties sincerely as invigilators. 
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Custody o: examination ’/laterials 

C, C. DAVID 


Examitation materials include : 

(fl) Hall ticketsCorcandidates. both regular and privale, for purpose 
of identification, 

(b) Instructions to candidates to prepare them for ihe writing of 
examinations, 

(f) Question papers, 

(d) Answer books, and 

(e) Instruction^ to chief superintendents. 

(a) Hall tickets of regular candidates sent from the uni\ersit\ arc 
issued by the principals of colleges who arc usually the chief supcrinicn- 
dents as they can identify them. Hall tickets of private candidates also 
are issued by chief superintendents. The normal practice for the hall 
tickets of private candidates is to include photograph of the candidate and 
identification of signature by a responsible officer. It will be helpful if the 
hall tickets of regular candidates also include photograph, in view of Ihe 
fact that i t a college with a large number of students, neither the principal 
nor the members of staff, who are usually the invigilators, can identify all 
students. This will also be of help in identification of candidates by exter¬ 
nal invigilators, who are appointed from different colleges. 

(b) Instructions to candidates have to be as clear as possible so that 
no student commits an offence through ignorance. These instructions, 
printed clearly, must be supplied to the candidates along with their hall 
tickets. 

(c) The examination materials can be tampered with by interested 
persons if the arrangements for their safe custody are not adequate enough 
or the chief superintendent does not take his duties seriously. This can 
be prevented to a considerable extent by coding the packets of question 



papers, thereby making it impossible to identify particular packets. There 
must be a strong room with an iron safe at every examination centre for 
keeping the question paper packets received from the university, just one 
or two days before the actual commencement of the examinations. The 
safe custody of the question papers is the most important responsibility of 
the chief superintendent of the examination centre. The safe must be 
scaled after use every day. One set of keys of the safe must always be with 
the chief superintendent. The other set of keys must always be kept in a 
scaled cover, ready for inspection by the controller of examinations or his 
deputy at any time during the course of examinations. The controller of 
examinations shall conduct surprise inspections of centres whenever possible 
during the course of examinations. The surplus question papers must be 
returned to the university immediately after examinations every day in a 
specially sealed cover. A careful check of the number of unused question 
papers returned to the university will help to find out whether there has been 
any removal. 

U!) Answer books can carry identification marks which differ from 
examination to examina'ion. Also a series of identification marks can be 
u.scd for the whole examination and the answer books with a particular 
identification mark can be chosen at random at the time of examination. This 
arrangement makes it impossible far the candidate to know before hand the 
answer books which will be used for a particular examination. The taking 
oiil of blank answer books surreptitiously and the introduction of prepared 
answer books, cither at the examination hall or after, can thus be prevented. 

The unused answer books if sent back to the university involves addi- 
lioiial expenditure and poses problems of storage for the university. The 
answer books, if they are to be used for subsequent examination, will have 
to be rcdespatchcd to the centres. Other alternatives are to store them at 
the centre or destroy them. Storing them at the centre makes them easily 
accessible, for removal by interested persons for purpose of malpractice at 
later examinations. This becomes easier during the period between exami¬ 
nations when attention is not so close as during the course of examination. 
Answer books, if supplied on the basis of an accurate calculation of actual 
requirements, will not be in surplus and hence the university can afford to 
have the small number of unused ones destroyed. However, unless dif¬ 
ferent identification marks are used for each examination, a careful check 
will have to be maintained on the destroying of answer books as well. 

(c) Instructions to chief superintendent have to cover all aspects of 
the conduct of examinations in detail. The duties and responsibility of the 
chief superintendent are to be outlined. Methods to forestall difficult 
situations which can be anticipated, should be included. The instructions 
should serve the purpose of a guide-book. 
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Appointment o: 3xaiiiiners 

W. H. GOLAY 


PREPARATION OF PANELS OF EXAMINERS 

The present practice is that the university invites applications lor ap¬ 
pointment as examiners roughly at the beginning of each academic jear. 
The board of studies concerned is supposed to scrutiniic the applications 
and place on the panel the names of those persons who satisfy the minimuiu 
requirements regarding academic qualifications and teaching experience. 
The number of members of many boards of studies is so large (sometime^ 
as many as 50) that calm consideration of the merits of the applicalioih 
becomes very difficult. The administrative problem is further complicated 
by some members suggesting non-applicants without giving full details 
regarding their names, qualifications, teaching experience and address. 

A certain committee, appointed by the Inter-University Board of India 
a few years ago, had suggested that the membership of boards of studies' 
should be restricted to 12 to 15 persons at the most. It is very necessary 
to amend the university Act and rules suitably, so that the member^^liip 
of no board of studies exceeds 15. Similarly no names of non-applicanis 
should be entertained at the meeting of the board of studies while preparing 
the panels unless full details are available. 

appointment of examiners 

The normal procedure for appointment of examiners is that the 
panels prepared by the boards of studies are scrutinized by committees 
appointed under the appropriate provisions of the university Act for ap- 
appointment of examiners. The recommendations of the committee are then 
placed before the Academic Council which then makes suitable recommen¬ 
dations to the Executive Council for the final appointment of examiners. 



Under the provisions of Act, the discretion of the Executive Council in 
changing the recommendations of the Academic Council in regard to the 
appointment of examiners is very restricted. Virtually, therefore, the recom¬ 
mendations made by the Academic Council are accepted. 

UNFAIR MbANS 

The most common form of unfair means employed by candidates at 
public examination is copying. Senior supervisors have standing instruc¬ 
tions to expel students found employing unfair means during an examination 
from the examination hall and not to permit them to appear at subsequent 
papers. The student's statement as well as the statement of the invigilator, 
who detected the case of copying, is recorded by the senior supervisor, who 
makes a confidential report to the registrar along with the necessary docu¬ 
ments, such as the answer book, scraps of paper found, etc. Other less fre¬ 
quent unfair means are: (I) impersonation at any examination and (2) 
bribing menials in the university office for the purposes of substituting ans¬ 
wer papers, which have already been assessed, in the university godowns. 

The Executive Council appoints each year a committee of its own to 
investigate cases of unfair means employed during the examination season 
of that particular calendar year. The procedure followed by the committee 
is that the candidate alleged to have resorted to unfair means are called for 
interview before the committee, their statements are recorded, they are cross- 
examined and (he committee then arrives at a conclusion. In some cases, 
the committee feels that sufficient evidence docs not exist to sustain the 
allegation of cop> ing and exonerates the student. Very often the commit¬ 
tee IS satislicd about the guilt of the students concerned and according to the 
gravity of the olTcnce the punishment is recommended to the Executive Coun¬ 
cil, whicli is debarment from appearing at a university examination for one 
year or two years. Normally no student is debarred from appearing at a 
university examination for more than two years. 

■fherc are some cases of malpractices being resorted to by paper-setters 
and examiners. Poona University had a case a few years ago, where a cer¬ 
tain examiner demanding illegal gratification from students appearing at 
practical examination.s was trapped with the help of the police and prose¬ 
cuted in a Court of Law. He was, however, acquitted on the ground that 
the anti-corruption law applies only to public servants and the examiner con¬ 
cerned could not be described as a public servant within the meaning of the 
Act and he was, therefore, acquitted. Serious attention needs to be paid to 
remedying such a situation. 
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examination Sc'.iedu'.es 


B. F. SHAH 


EXAMINATION PROGRAMMES 

In arranging the cxantination programmes the following points arc con¬ 
sidered : 

(1) The number of examinations 

(2) The number of students appearing at a particular examination 

(3) The number of centres 

(4) Accommodation available at centres 

(5) Capacity of the presses in printing the question papers 

(6) The last working day in a particular fkulty 

In our university the written examinations start from the second week 
of March and last upto the end of the month of May, The majority of 
examinations are held between the period iSth March and 30th April. Exa¬ 
minations are not started before the close of the second term except in some 
extra-ordinary cases. 

In this part of the country i.e. Gujarat and Maharashtra, students are 
allowed to keep terms simultaneously for two courses—one undergraduate 
and the other postgraduate. I do not know what is the practice in other 
universities. The practice started, I suppose, when the examinations for 
the Masters' degrees were held at the end of the second year. Now that 
examinations even at the Masters' degrees arc held at the end of the first 
year it is for consideration whether the concession granted in good old days 
should be continued. In our university we have introduced semester 
system at the M.A., M.Sc, and Law examinations. Examinations are held 
at the end of every term. In the examinations held in the first half of the 
year it is possible to accommodate students appearing at two examinations 
simultaneously but in the second half of the year it is very taxing. It is 
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In arranging programmes of ihe examinations to be held in the second 
half of the year, the examinations have to be started before the close of the 
term. Alternatively the vacation after the second term has to be increased. 


GAPS BETWITN EXAMINATION SESSIONS 

Generally examinations in Medicine, Engineering and Law are held 
twice during a year. As regards other examinations, the practice varies 
from university to university. In universities in North India and Madhya 
Pradesh supplementary examinations arc held in July, August or September 
for the benefit of students who have failed in one subject only. 1 under¬ 
stand that there is no provision of gracing in those universities. 

In this part of the country, students are allowed to keep terms for next 
higher courses if they fulfil certain requirements laid own by the university 
concerned. There is a persistent demand from students that they should 
be given an opportunity to clear their subjects in the lower examinations 
before they appear for the higher examinations. If this request of students 
is granted it will amount to holding all the examinations twice a jear. It 
is needless to point out that this would involve heavy strain on adminis¬ 
tration. 


declaration or rtsults 

The expert committee appointed by University Grants Commission to 
report on exaniinulion reforms has recommended that the administrative 
work connected with the examinations should be reformed with a view to 
avoiding delays in publicaiion of results. 

The stages between the conclusion of an examination and declaration 
of its results are as under ; 


Where code numbers are given 

1. Receiving the answer books in the university office 

2. Verification of answer books with a view to examining whether any 

identification marks are made in the answer books 

3. Giving code numbers 

4. Sending the answer books to examiners 

5. Valuation of answer books by examiners 

6. Receiving the marks sheets from the examiners 

7. Decoding and tabulation 

8. Declaration of the results 

9. Preparing the marks sheets and sending them to colleges. 

Where code numbers are not given 

1. Sending the answer books to examiners 
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2. Valuation of answer books by examiners 

3. Receiving the mark sheets from the examiners 

4. Tabulation 

5. Declaration of the results 

6. Preparing the mark sheets and sending them to colleges 

It is an accepted fact that people try to influence the examiners by fair 
or foul means. For the sanctity of examinations it has become imperative 
to adopt the system of giving code numbers to at least those examinations 
that decide the future of students. 

Last year in our university code numbers were given at the first B.Sc. 
examination. There were in all 1,415 students. Separate code numbers 
were given for different papers. For one paper one person had to put in 
about 60 hours work i.e. about a week is taken in giving code numbers. 
This time could be reduced if the pages of the main answer book are increas¬ 
ed. The quantum of work will depend upon the method of giving code 
numbers adopted. If the method of giving code numbers is to be extended 
to final examinations also, the work has to be entrusted to senior teachers 
and/or principals. It is not possible for the ollice alone to cope up with the 
increased work. The time required in giving code numbers has to be reck¬ 
oned with. 

Time to be allowed to examiner for assessment work 

Normally three w^eeks arc given to examiners for valuation of the answer 
books. Ordinarily an examiner is given about 300 to 400 answer books. 
The time given is quite reasonable. It is not possible to give this much 
time to examiners for the examinations held in the second half of the year. 

A difficulty arises when the same examiner is appointed at a number 
of universities. If the dales of submi.ssion of mark sheets at dilfcrcnt 
universities are difl'erenl, then there is no difliculiy. But if the dates of 
submitting mark sheets to dilfcrcnt universities coincide, a real dilllculty 
arises. It is desirable to involve senior teachers from other universities in 
valuation work. It would be ideal if the universities in a particular region 
can adjust their examination programmes in such a way that the last dales 
of submission of mark sheets for a particular examination do not collide. 

When an examiner accepts work from more than one university and if 
he is required to overwork, the quality of assessment is bound to suffer. 
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Six 


Zxamination !^esearc-i Unit 

SHIB K. MITRA 


QUESTION PAPER 

There is trequent trouble over the questions set in an examination, 
(fl) The questions may be considered to be too dilTicult; (b) they 
may not be on topics mentioned in the syllabus; (f) they may be 
written in a language which is difficult to understand; (d) all the ques¬ 
tions in a paper may not be evenly spread over the entire syllabus; and 
{e) the questions may have leaked out. 

EAtLlRI 

Any unisersity is concerned over the rate of failure in an exami¬ 
nation. It wants to control the rate and keep it within reasonable limits. 
Students create trouble over failure, if there arc too many failures. 
Students are disturbed over the fact that some fail by chance. 

MRST CLASS 

(fl) Like the rate of failure, a university wants to control the 
r.itc oflirst class graduates. Rightly or wrongly, it is believed that the 
rate should be low in the interests of standards, (b) There are more 
first classes in some subjects than others, (c) Students (arid some 
teachers) get agitated over missing of first class by chance. Like those 
who fail, those who got first class stand out in the student community 
and therefore the community is concerned over who stand out and 
whether this is Justified. Not only must justice be done, but also 
appear to be done. 

ADOPTION OF UNFAIR MEANS 

Although there has always been some cases of students adopting 
unfair means in an examination, such practices have increased in 
recent times. 



There are various other problems like tabulation and marking 
errors, appointment of invigilators and examiners, distribution and 
collection of answer books, confidential printing of question papers, 
holding of examinations according to schedule announced well in ad¬ 
vance, quick announcement of results, etc. These are, in a way, inter¬ 
nal problems for the examining body and will not be considered in this 
paper. It should, however, be noted that managerial and organis¬ 
ational problems like these can be tackled by the methods of opera¬ 
tions research which should be within the purview of an Examination 
Research Unit. 

RESEARCH TASKS 

We shall consider briefly, in relation to the problems enumerated 
above, what the tasks are for a research group. 

RESEARCH TASKS IN RELATION TO QUESTION PAPER 

(■/■) The difficulty value of a question can be determined from a 
sample of students being asked to answer the question before the ques¬ 
tion is actually set in the examination. There are diflicullies in this 
because the time gap between the paper setter s appointment and 
examination is not much and the students in the sample who answer 
the question will have an advantage over those not in the sample in 
case the question is finally set. Try out of questions for estimating 
the difficulty value prior to the actual cxaniiniition can be dime only if 
teachers are encouraged to try out questtons throughout the academic 
session. The paper setter need not be one of these teachers. The 
paper setter will be supplied with the set of questions as written by the 
teachers along with the difficulty values of each question. This 
becomes a kind of pool of questions from which the paper setter may 
draw the final question. The moderators also should have access to 
this pool and if they disagree with the paper setter they may select 
some other question. 

(ti) An alternative Way of estimating ,lhe difficulty of question 
may be devised as follows: Get an ideal answer for each question 
set from the paper setter. Then get a sample of teachers to answer 
the same question under two conditions. I'/z. (a) as best as they can 
and (h) the answer that an average student in his opinion is likely to 
give. The wider the discrepancy among the ideal answer given by the 
paper setter, the best answer given by the teacher and the answer that 
the teacher expects the average student to give, the more difficult the 
question. The problem here is secrecy. In order to maintain secrecy, 
one should try out a larger number of questions including the ones 
set by the paper setter. Or, give one question to one group of 
teachers, another question to another group and so on. 

(iii) It is necessary to determine the difficulty value of each 
question in every paper set in an examination each year. This can be 
done after the examinations. The results should be fed back to the 
paper setters. While the two previous methods were suggested for 
pre-testing a question, the present suggestion is a method of post¬ 
testing the difficulty value of a question. The expectation is that if 


246 



the inrormation about difficulty is regularly fed back to paper setters, 
examiners and moderators, they will learn to adjust the difficult level 
of new questions to be set on the model of the previously set questions, 
the difficulty values of which are already known. 

(ii’) One of the ways of avoiding the trouble over difficulty of question 
is to set more questions in a paper. If in a paper one has to answer six 
questions out of ten, the variation in difficulty value of the ten questions is 
much more important than when six are to be answered out of twenty. With 
few choices one cannot avoid difficult questions. Increasing the number of 
questions has the other advantage of covering more easily the syllabus pres¬ 
cribed for the course. The problem of questions not being evenly distributed 
over the entire syllabus can also be tackled by increasing the number of ques¬ 
tions. Whether questions are .set on topics outside the syllabus needs care¬ 
ful scrutiny by the board of moderators who should be aided by a factual 
report of what topics have been actually taught by the teachers in the col¬ 
leges. A sample survey of college teachers can be quickly done to ascertain 
this. 

(r) Then there is the problem of making the language of the question 
such that it is readily understood by the examinee. It needs empirical 
studies of students' perceptions of meanings of words and questions. 
Questions of several years may be analysed linguistically and empirically 
and the results should be fed back to the paper setter, examiners and 
moderators. Experiments on the intelligibility and readability of question 
need to be done. 

RI:.Sr.ARCt( TA.SRS IN RPLATION TO TAILLRE 

(/) The dilliculty \alues of the questions in a paper determine the rate 
of failure on that paper. It is therefore necessary to control the difficulty 
level of a paper in order to control the rate of failure on that paper. If, 
however, the examination results show that the failure is relatively higher 
in one or two papers, inspile of efli'orts to control the difficulty of questions, 
statistical adjustment can be made so that failure rate is more or less evenly 
distributed over all papers. In order to control the rate of failure which may 
vary widely from subject to subject and from year to year, it is necessary to 
make statistical adjustments so that the area under the curve of the distri¬ 
bution of marks in every subject remains more or less equal. Otherwise 
there will be easy subjects and difficult subjects. There will be the chance 
element associated with the year. One is just unlucky because one has 
appeared in the examination in a particular year. The year to year and 
subject to subject fluctuations, as much as paper to paper w'ithin a subject, 
should be statistically controlled. 

(;■/) The chance clement associated with the examiner should be re¬ 
duced. By empirical studies examiner leniency or stiffness should be deter¬ 
mined. The.se findings about individuaf examiner's idiosyncrasy or bias 
.should be fed back to all examiners, paper setters, etc. As a result of this 
feed back the examiners are likely to become more balanced and the un¬ 
reliable examiner i.solated. 

(///) The cut-off point below which a student fails is arbitrary. The 
reliability of marking at the cut-off point may be different from the reliabi¬ 
lity of the entire range of marks. In order to increase the reliability of 
marking at the cut-off' point, it is necessary to establish a band, say of five 
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marks, on either side and re-examine all scripts falling in this band. This 
should be a routine matter to follow immediately after the statistics on any 
examination are available. 

(iv) Improve generally the reliability of marking by (a) two examiners 
marking the same scripts independently, (b) spotting out the unreliable 
examiner, (c) controlling the method of reading and evaluating scripts ques- 
tionwise, arranging in nine or eleven piles in rank order, arranging scripts 
in rank order within each pile and then marking, (r/) limit of the number of 
scripts per examiner (empirical study to determine the optimum), (e) rando¬ 
mising the distribution of scripts (as in Gauhati), etc. 

(r) Analysis of the consistency of performance across the papers in a 
subject should be regularly done. One should ordinarily exprect a high 
positive correlation between papers in a subject. Besides, the distribution 
of marks in every paper should be scrutinised for discontinuity. Cases 
which stand out in such statistical analysis should be re-examined. Like the 
inconsistent examiner (a la'Taylor), the inconsistent examinee needs close 
study. 

RESE.\RC1I TASKS IN RELATION TO THE EIRST CLASS 

The tasks are similar to the ones spelled out above in relation lo failure. 
Only the cut-olV point is at the high end of the curve of dislribution of marks. 
It is not necessary to repeat the same points. Only one thing may be said. 
First classes are much fewer in number as compared to failure. Upsets in 
first class, therefore, are more easily noticed and become the focal point of 
agitation. So it is important to pay more alleniion to the problem of mis- 
classihcation at the high end of the distribution. Lverv precaution needs 
to be taken to reduce the element of chance. 

Both statistical as well as other operational steps should be devised on 
the basis of actual research data. Of particular importance in this context 
is the problem of yearwisc variation and it is necessary to introduce some 
kind of Scaling to make the first class of agiven year somewhat iiKlependent 
of the chance factors operating in a year. One way w ould be to repeat some 
questions every year, which is contrary to Tlic present practice. Somehow 
there is a prevalent opinion that there must be an clemcnl of newness in the 
questions. What happens in practice, however, is that sludcnls eliminate 
the questions set in the previous year. Ihcy, therefore, do noi siudv certain 
portions of the syllabus which are also omitted by the paper seller aceordmg 
to the instruction received from ihe controller of exaininalions. By inielli- 
gent elimination of questions, students hit at most of the questions set. Their 
answers to these questions arc. therefore, not thought out in the c.xamina- 
tion hall, as the opinion about newness of questions implies. Students' 
practices and habits in this regard need to be studied. 

RESEARCH TASKS IN RELATION TO THE ADOPTION OE IINEAIR MEANS 

Ordinarily, it requires punitive and restrictive operations of the 
police type rather than research in order lo check the adoption of unfair 
means in examination. But the study of any society shows that there is always 
some deviant behaviour in relation to norms of conduct. Usually it is an 
inverted capital j-curve showing that large deviations occur less frequently 
than small deviations. When large deviations begin to occur frequently, 


248 



one needs lo examine closely the norms and the regulatory forces which 
control normative behaviour. Attempts will have to be made through the 
techniques of social psychology to understand exactly how the deviation 
takes place. Attempts will have to be made to develop new norms and 
regulatory forces. 

While on the topic of group psychology, certain other issues may also 
be touched upon. Today in a large affiliating university an important asptect 
of the trouble over the first degree examination is the frontal conflict bet¬ 
ween university administration and the students. Much of it is largely due 
to the fact that paper setters and examiners are anonymous and the teachers 
of these students are nowhere in the picture, not even as invigilators. This 
situation encourages other groups in the educational game to avoid blame 
and increases the vulnerability of the administration in the eyes of the studen¬ 
ts. While such secrecy and anonymity might have developed in our society 
lo ensure justice and sanctity, today wearein the midst of a social change 
where we have to think whether this secrecy and anonymity is not only not 
serving their original aims, but are really contributing to undesirable events. 
It is belter to give back to the teacher his old position of guru in our society. 
The teacher vsho examines should be publicly announced as such. He 
should announce the mode of examination ; written, practical or oral. 
The public should be allowed to see the examination, if a teacher so decides. 
He should certify on the basis of his examination the marks awarded to 
each of his student. 

One may react sharply to this proposal and say that there will be com¬ 
plete anarchy, But it need not be so. What is being suggested is complete 
decentralisation of cxaininution which alone will bring greater involvement 
of teachers in colleges in the conduct of examinations and will reduce the 
bipolarity of the field, v/r. administration rj. students. Not only psycholo¬ 
gically . but pedagogically also it is a sound principle which is being advocated 
here. V/e. the teacher should be at the centre of teaching and examination. 
Today he is only at the centre of leaching. iE\en this is questionable with 
regard to college teachers). In examinations he is only a wage-earner. 
Now. lo avoid anarchy what should be done is lo set up subjectwise board 
of teachers in each college. Some colleges will tend to get together and run 
a common examination by setting up a common board. There is no harm 
in this. The teacher who has actually taught the subject will set questions 
from the portions he has taught. There may be some variations in this 
which will gradually be ironed out as the system begins to operate and market 
pressures begin to act on the teacher. The questions will be scrutinised by 
the hoard and the entire examination on that subject will be conducted by 
the board in a college. One may apprehend trouble over favouritism and 
other kinds of unfair practices, if teachers are left to themselves to teach, 
set the paper and also grade them. This may happen in the beginning, but 
soon the pressures of the public as well as the internal organisational logic 
will force the teachers to be what they naturally arc—decent citizens. What 
about comparability of standards from college to college? One may ask. 
This can be done in various ways. There may be a few common questions 
to enable scaling of one college against another. The Examination Research 
Unit may feed back to each college a study of how well does its examination 
difficultv, coverage, reliability, distribution of marks, marker variatjon. etc. 
compare with other colleges. Soon, as a result of this, consensus will begin 
to emerge as well as self regulation of norms. Today it is the business of 
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academicians in the universities to set norms and uphold standards against 
contrary pressure from the college who in their turn are pressurised by 
students. 

EXAMINATION RESEARCH UNIT 

From the discussion on research problems and tasks in the preceding 
pages, it follows that several functions will have to be performed by an 
Examination Research Unit. It can be called by any other name. 

(1) The ERU will have to do considerable statistical work. Statistical 
analysis will have to be one of its main functions. 

(2) It has to undertake quick sample survey of opinion, attitude, 
practice, etc. of students and teachers. 

(3) It has to make linguistic and other kinds of analyses of questions, 
prepare pools of questions and devise ways of improving question setting 
practices. 

(4) It has to undertake experimentation and research on social, peda¬ 
gogical and psychological aspects of examinations. 

In order to carry out these functions eflicicnlly. it has to have easy 
access to the office of the controller of examination as well as the regis¬ 
trar. But it should not be a part of the adminisiraiion. It has to be set 
up outside the faculties too. This very position of the ERU will be to the 
advantage of the university in generating confidence among the public and 
the students. It can have a large specialised stall'with quick data processing 
facilities, in the long run. To start with there should be a small sialf with 
ranks equivalent to the registrar and controller and their deputies. The rest 
of the staff, at professor, reader and lecturer's level should be on second¬ 
ment from the deparlments of the university. It should work through 
committees subjectwise as well as otherwise. These commiliees should 
have as their members as many from the colleges as possible. The idea 
is involvement and training in methods of examination. To ensure large 
participation, the committees should be allowed to invite other spcciali'-i', 
in the field Also one third of the members should retire each year to allow 
quickly a large body of teachers of various subjects from various colleges 
to get an idea of what is involved in conducting an cfhcieiu examination. 

The preceding discussion has centered on the first degree and the 
college. The principles, however, can be generalised without much trans¬ 
formation to cover the examinations at the postgraduate stage. 

In the end, it should be pointed out that this paper has only raised 
certain issues and discussed the solutions tentatively and in a broad way. 
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examination Reform 


K. PATEL 


Examination is a means of evaluating whether the objectives of teaching 
and training have been satisfied. Hence, we must have a clear concept about 
the approach to teaching and learning before discussing evaluation. 

TJIC SY.Sri;M AS IT EXISTS AND SOME QUERIES 

Some students arc verbal and able to communicate their ideas and 
thoughts. The present system of examination, through essays, favours these. 
Others, who arc not verbal, stand to lose a great deal, though they may be 
able to comprehend verbal material and possess several other important 
potentials. A just and valid system of evaluation should not penalise such 
students. 

: Our universities are few in number and only a small frac¬ 
tion of Indian youth, with the best academic records can enter their portals. 
When the students join the universities they are high academic performers. 
How is it that after two or three years in the universities they become drop¬ 
outs and are branded as useless and incapable of benefitting from education? 
What arc the causes for the large percentage of wastage witnessed in our 
education system at the universities level? Is it the system of teaching or 
examining that is faulty? How can it be improved so that the potentialities 
and level of growth of the students may be validly measured? 

TJic pcrffci fli/jii'cr: In all examinations, the question of what should be 
considered the perfect answer is ever present. Who is to determine the 
perfect answer and should there be any flexibility in determining the perfect 
answer? If there is a perfect answer given, then why does not any student 
in a university examination attain that perfect level? What are the criteria 
to be applied for determining a perfect answer and how are the levels of 
performance to be established so as to do justice to students? 



SUllVEY OF students' IDEAS ABOUT THE PRESENT SYSTEM 

A survey of the students' ideas about the present system of education 
was conducted in West Bengal. Some extracts from the opinions given by 
students are reproduced below : 

“The outcome of the present day system of leaching and examination 
is to make the students' mind a pigeon lioL- of facts, while the real task of 
appreciating the logical integration of discoveries and creative thought is 
largely masked the cxaminalion must evaluate the students' ability for 
independent thinking and his education must provide him with opportuni¬ 
ties for undertaking independent work and solving real problems through 
projects".... 

“The present system of examination evaluates the student's power of 
memorizing through a set of stock questions. The syllabus set is so huge, 
it is practically impossible to study, so the student leaves out the ‘unimpor¬ 
tant portions' and concentrates on the 'important' portions in order to 
score high marks in the examination and so to succeed." 

“Judging from the questions that appear at the university examinations, 
it seems as if the paper setters arc not interested in doing their duly which is 
to evaluate the true merit and growth of the pupils. Year after year the same 
questions are churned out of the university machine and frequently the stu¬ 
dents are heard t) say 'no, no this question cannot come this year, it has 
already been set last year' or ‘there is a high probability of this question ap¬ 
pearing this year as it has not been set for three conseeuiive years'. If this 
is so then why have paper setters? A computer would probably help to 
choose a more random set of questions than the paper setters of the uniscr- 
sities." 

“A good student must display many other abilities and skills besides 
those evaluated by the conventional university examination. College edu¬ 
cation is supposed to make students alive and alert. It must not choke them 
or bore them and examination must be a challenge and not a death knell 
that it seems now-a-days." 

Students express a preference for a mixture of objective multiple choice, 
matching and short essay questions to evaluate critical and analytiel think¬ 
ing and judgement overlong conventional essays locvaluale their growth and 
performance. According to them “examination must discourage the popu¬ 
lar practi e of doing nothing the whole year round, hastily cramming a feu 
selected questions from selected chapters just before the cxaniination, dis¬ 
gorging the information in the answer scripts and then forgetting for c\er." 
The questions must be evenly spread over the syllabus so as to discriminate 
between those that have a clear and deep understanding of the subject and 
those that rely on luck or the authenticity of their source of suggestions. 

A university course is, or should be, designed with a particular student 
product in view. If the aim of the university is to create wailing rooms for 
the unemployed to spend their time in, then nothing matters. But if students 
feel that after having ploughed through a university, they find nothing to 
ignite the spark of creativity or to measure its growth then the matter deserv¬ 
es serious attention. "What the university authorities have failed to realize 
is that learning a subject to good marks in examination and really know¬ 
ing it (understanding its principles and applying them) arc quite different 
things. Though many students manage to score high marks thrcaigh clever 
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svu4w\v V.VCA V\vdV Y,ou\d nol be so bad d Ihe paper setters had not been 
so atcaid of improving the system of examination and the authorities able 
to use their imagination and insight to understand the needs of the students 
for proper training.’’ 


tVALUATlON or MULTlRLt POTLKri.ALS 

Truly creative students even with academic potential, fail in our colleges. 
Dr. Calvin Taylor, coordinator of the Eighth Inlernational Creativity Re¬ 
search Conference noted that colleges fail most students because they pro¬ 
vide programmes designed to measure academic ability and ignore many out¬ 
standing abilities that people have and need in the world of work like plan¬ 
ning, organizing, evaluating, forccasttng, creating, decision making, pro¬ 
blem solving and communicating. According to R.J. Latken, Ex-Director of 
NASA "the broadest and most cruel discrimination practised by the edu¬ 
cation svslcm is again.st the greatinajorily of students who donot happen to 
have or do not care to usc, the potential of academic abiljly.” He indicated 
that change in the education .system will only come through the work of 
oul.siders as “educators, even if committed to reform, are too clc'sc to the 
.syslcni to change it". Happily, the present seminar is evidence of 
educationists who are committed to change and look forward to seeing the 
fruits of their labours. 

It is suggested that our universities group the potentials, characteristics 
and skills icquired in the world-of-work. work out the profile of each stu- 
dcnlfor all Ihcdin'ercni aspects andoblam a true image of each student and 
h's growth. The system then would reach out to each and e\ery -tudent 
in our univcrsilic-S and find some promise in all students from all parts of 
our society. Uy doina so the universities would not be lowering the 
standards, but only changing the standards, of opportunity and surely 
there is nothing wrong with that. The universities cannot remain long 
as castles to be entered into, and used by, a specially selected elite only. 
It is antieip.ilcd that a large proportion of the population will be beating 
tit the doors of the universities in the future and the problems of proper 
evaluation would become more and more acute. In the light of what is 
possible in terms of the multiple potential approach, all our university 
students arc deprived and many of their most important potentials go 
completely unooiieed and uoevaluated. 

Today by branding a student with low' marks, at one trial on five essays, 
as a misfit, the univ'crsily kills his chances for ever. Employers have sc^t 
respect for the marks obtained by students in university examinations. By 
evaluating and presenting a profile of all the abilities and potentials of a 
student, a university degree will gain the respect it so richly deserves and the 
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student will gain the recognition he needs after putting in three or five years 
of labour. 

EXAMINATION REFORM AND EXISTING CONDITIONS 

Examination and educational reform must be considered against ihe 
backdrop of the current national frustration at the dropping standards and 
decreasing discipline. People are getting tired of waiting for educational 
reform and for some one to provide proper education for their words— 
education that is relevant to the needs of youth and our age. Since our 
universities seem to read the signs of lime, it is high time for our universities 
to re-examine their practices and purposes, stop using the technique of teach¬ 
ing used in Britain and Europe during the rennalsance, loosen rigid curri¬ 
cula and techniques of evaluation, curb the old absurdities of branding most 
young people as misfits and introduce innovations. This is the crucial time 
for Indian universities (higher education) to promulgate new reforms, 
introduce experiments and slough off non-productivc practices. 

So far our universities have been most sluggish to introduce changes and 
have concentrated on sitting on judgement on youth. It is high time for 
them to end their sole preoccupation with judgement; display sensitivity to 
the needs of youth and the times and start thinking in terms of helping the 
students. This they can do by developing clear objedives. rcliabilc and 
valid tests to evaluate more precisely the potentialities of studenls and the 
amount of growth that has taken place between reasonable intervals and 
also by guiding the colleges on the type of instruction that would produce 
the growth of all the potentials. 

STUDENT RESISTANCE TO CHANGE 

Resistance from students for changing the system, structure and methods 
of examination is anticipated. It is our experience that clearly explaining 
the general and specific objeciives of the examination belies the fear of the 
unknown and forestalls resistance to change from student groups. All 
objectives of setting each paper are clearly explained lo all students via 
instructio .s to candidates. Students are suspicious of examination autho¬ 
rities because they don't know what i-. wanted and furihcr arc suspicious 
that authorities will add some more unknown elements lo their already 
existing troubles. The younger generation today views the university as a 
machine responsible for their misery, repression and frusiralion. 

The ultra-radicals in any institution or university can never be appeased. 
Their aim is to make trouble, not to seek redress. However, they can be 
made relatively impotent if the establishment can ensure that they do not 
gain much of a following from the less militant majority. The authorilie.s 
must, therefore, make concessions and changes for the benefit of the mode¬ 
rate majority before they join the ultra-radical minority and forestall 
trouble. 

SOME SPECIAL PROBLEMS CONSIDERED 

There may be some problems that are common to many universities 
but many problems would be specific to a university. Each university must 
have its own research and evaluation cell for dealing with its problems, deve- 
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dures and lecWqucs. T^ic pcopk who help to design our lefts, and^ei^t 
our awardees ai\says express great interest in our techniques and wish that 
these techniques could be introduced into the system of evaluation of their 
university, but equaljy often they express the futility of suggesting the 
changes as the massive examination machinery of the university is not open 
to change. 


INTERVAL ASSl.SS.Str NT 01- EACH STL'DLNT 

There is a school of thought that subscribes to the theory that all exami¬ 
nations must be the sole responsibility of teachers and a// examinations must 
be conducted inlcnially. This raises the question about the trustworthiness 
and ability of teachers to assess their own students. In theory, they should 
be able to make the best job. This belief is based on the criteria that (a) 
ihe teacher is competent in teaching and evaluating (which is not always so) 
(b) the teacher i- .sufliciently interested and perceiving to study the student 
m all aspects (w'hich unfortunately is not our experiencce) (c) that the teacher 
is honest enough to separate his subjective attitudes and forget the brushes 
that he had with the student to form a true objective assessment of the stu¬ 
dent. (The tendency to hold the marks over the student's head as a sword of 
damocles to coter him into submission and stop him from asking questions 
IS ever present.) Of course, the system has certain advantages, foremost 
among them being that of maintaining discipline. 

The system of complete internal assessment has had to be modified 
even in a country like L'.S..^. In order to establish certain basic standards, 
organisations like the College Boards and Educational Testing Service have 
been c-stablished. These today perform the functions that our Board of 
Secondary Education and universities are performing. If Indian univer- 
.siiies want to go tlirougli the whole process and arrive at the same conclusion 
t .rough their own experiences, then certainly decentralization may be 
experimented with. 

St'GGE.STtONS rOR CHANGE 

In the light of the foregoing and on the premise that the i^^versity exists 
to serve the needs of the students and its image must be that of a friend, 
philosopher and guide, the following suggestions are offered: 

1. The policy on examination reform must be long range. Short 
range measures may be adopted only as interim measures. 

2. A band of teach.rs from all over India should start spelling out 
the general and .specific obje-Tive.s of setting questions: the course to 
be covered at each lesel. the range of difficulty value of questions 
needed and other characteristcis of the questions. After preparing 
and trying out the que.stions, they may be retained in a common 
centr. I Question Bank from which the universities may draw as 
and when necessary. 
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3. In preparing a question paper, let the teachers give the characteris¬ 
tics of the questions required, e g., the difficulty value, abilities and 
characteristics and knowledge to be measured and the weightage 
to be assigned to each characteristic. All information about the 
characteristics of a question may be stored in the memory of a 
computer. The details of the characteristics of questions wanted 
for an examination may be fed into the computer so that it would 
randomly pick out the questions to form a whole paper as and 
when required. In this way all questions w'ill be objective based. 
The only person that need really know the question paper is the 
controller of examinations. 

4. Let two or three equivalent forms of the question paper be prepared 
with different questions. Randomise the order of the questions 
in each form of the paper to gel another three versions. Thus, 
altogether nine versions of the paper will be available for immediate 
use. With nine different versions to cope with, the printing costs 
will certainly shoot up, but it would be a challenge to the students 
to cheat, even with mass media. 

5. The students must be clearly informed about the ohjeLiives of the 
paper set before the examination. 

6. The evaluation of multiple choice, fill in blanks, matching, etc. type 
of questions should be computerized. Preference may be given to 
short essays as against long ones. The objectives of setting each 
essay question must be gi\en with the question. The essay type of 
questions may be evaluated intlepcnclcnily, by at least two examiners. 
Each of the examiners must exaluaie the same essay separately 
for each of different criteria sought to be measured. The discre¬ 
pancies may be ironed out at a joint meeting with the head 
examiner. 

7. The university must give clear directions to examiners of viva voce 
tests about the abilities, characteristics and skills to be evaluated 
at the \iva. Let the viva be tape recorded so as to ensure that it 
was really conducted properly and the student judged on each of 
the required aspects. By letting four or live competent persons 
listen to the recorded viva and give their own evaluation, it is 
possible to establish norms and to use bits from it for training of 
young examiners. 

8. The results of the examination may be presented in the form of 
per 0 ~intile ranks or percentile bands on diiTcrent aspects. Thus, a 
student would receive a profile of his performance and growth on 
each of different abilities, skills, characteristics and knowledge 
from the university. 

9. All university teachers must receive training in teaching and evalua¬ 
tion. 

10. Each university must establish a sychoiuclric, evaluation an'l re¬ 
search cell whose workers are directly responsible to the vice- 
chancellor. The successful working of the cell would depend on 
the following conditions; 

(a) The personnel working in the cell should be responsible 
only to the vice-chancellor of the university. 


256 



All data and information should be made available to them 
as and when they need it. 

(c) All affiliated colleges must offer whole-hearted cooperation 
and help to the officers of the cell. 

(d) The workers in the cell must devote their energies full time to 
the research and evaluation work of the cell. 

(e) The findings of the research studies must be implemented in 
action. The work of the cell should not be just a futile, 
intellectual exercise and its reports and recommendations 
must not be prepared only to be shelved. 

f f) Specialists may be called upon to cooperate on certain pro¬ 
jects being undertaken by the research and evaluation cell 
and to act as consultants, as and when necessary. 

(g) The cell must have the facilities of an electronic computer 
available for use. 

(7i) The schemes to betaken up for evaluation and investigation 
by the cell would be determined on the basis of priority. 
Some work in connection with the regular examinations like 
Viilidation. reliability, scaling, etc.w ould continue on a routine 
basi.s. 

(I) It would be the duty of the cell to sense the needs of studeiits, 
oiler guidance and advice to the authorities an on to im¬ 
prove and refine the testing procedures and ensure that the 
examinations keep up with the changes in the objectives, 
syllabi, text books, teaching practices and the needs of stu¬ 
dents. 

f/) The cell would be an objective, independent and impartial 
body of experts w hich would evaluate needs and offer recom¬ 
mendations. 

fit) Any one directly connected with the cell on any project 
must not be a paper setter, or examiner in the university, 
if the project deals with the examination with which he was 
associated. Similarly, no te.xt book writer may be directly 
connected with any project on text books. 

( I) The objectives of the cell would be to help ensure that uni¬ 
versity education is rel.'vani, quality oriented, elastic and 
sensitive to change. 

11. A central computerized service for matching student profiles vfith 
jabs should be maintained by the university. Data about re- 
quircmenis of empIo\crs and the characteristics of each student 
may be matched and the universities may recommend the most 
suitable young people to eraplovers. 
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Proiems o; Innovation 

DURGANAND SINHA 


The POINT PUT forward in this note is that modern iiiiunations in examination 
system require careful scrutiny with regard to their functioning under the so¬ 
cial conditions prevailing in the country and the facilities obtainable in edu¬ 
cational institutions and the pressure exerted by the student bodies and the 
public in distorting the results of the assessment system. It is also contend¬ 
ed that what is immediately needed at the present juncture is reform within 
the existing system of essay-type of examination rather than a wholesale 
change in the system. While the scientific superiority of the modern objec¬ 
tive tests is not denied, it is felt that it necessarily implies certain precondi¬ 
tions which are generally not available in the .educational institutions and 
the universities. The point of view that is adopted here is that introduc¬ 
tion of any innovation presupposes for its success certain structural and alti¬ 
tudinal transformations and changes in the norms of behaviour in the social 
system where it is proposed to be adopted. Without these, the innovation 
either gets rejected or its result is distorted leading to consequences which arc 
sometimes unexpected and undesirable. 

Without getting into the detailed examination of the scientific merits 
and demerits of new types of examination. I would discuss some concrete 
occurrences which have taken place in a number of educational institutioih 
frustrating the very purpose for which the reform is sought to be introduced 
The fate of sessional and internal as.sessments is a case in point. When 
internal assessment was introduced at the pre-imiversily level, it was often 
discovered that there was hardly any correlation between the marks obtained 
by candidates through internal assessment with the marks they obtained in 
the regular examination. Moreover, marks of the sessional and internal 
assessments were frequently found to be abnormally skewed on the high side 
The same students got considerably lower marks in their written examina¬ 
tions. This should not lead one to think that students did excellent work in 
their classes and slid down to a low level due to the abnormal situation ol 



an annu^ cxaminalion. Nor should ihis be taken to mean that due to the 
pTOvetbial nnTciiamht'y of the present system of examination, the marks 
obtained in the regular examination did not indicate the merit of the students 
while the internal assessment made by the teachers themselves who conduc¬ 
ted the courses should be relied upon. The fact of the matter is that the 
teacher had succumbed to the undue pressure of the social forces that sur¬ 
rounded him. If he happened to be in a private institution, he could not 
afford to displease the powerful members of the managing boards and with 
the system of ‘extended families ’ and liberal attitude adopted by the power¬ 
ful people in the community in readily extending a helping hand in spheres 
where help rendered could rarely be justified on moral and social 
grounds. Added to it is the pressure exerted by the powerful student 
bodies which, among other things, exert undue pressure on the teachers 
and administration for lowering of academic standards. In some of the 
universities in the north, the role of the student power in boosting up the 
marks of internal assessment cannot be ignored. It completely distorts and 
negatives the very purpose and justification for sessional work and internal 
assessment. 


Internal assessment by itself is an ordeal thing. The teacher who teaches 
the course is the most competent person to assess the students. But with 
some of the pressures on teachers indicated above, I would contend that in 
the contemporary social milieu and conditions prevailing in the educational 
institutions, there is certain degree of safety in the impersonality of the 
external examination. At least it is comparaiixely free from local pressures 
and student power which an ax erage teacher is finding increasingly difficult 
to resist end combat. 


The prevalence of mass copying and other kinds of corruptions in the 
examination are becoming increasingly w idespread and due to danger to the 
personal life and property, the teachers and the administration are finding 
It extremely difficult to check them. The new' type of objective examination 
where a question can be answ'ered in one word or a short sentence and with 
multiple-choice alternatives provided, widespread use of unfair means and 
mass copying are much greater dangers than in a regular essay-tape of exa¬ 
mination. Whispering and talking by the examinees c.iii reveal the correct 
answer more easily if it consists of a word, a sentence or an alternative and 
a loudspeaker fitted just near the examination hall and blaring out the ans¬ 
wers can be of maximum utility in objective type of questions. I have 
specially emphasized this point because use of public address system in 
dictating answers to the questions and free consultation within the examina¬ 
tion hall are not unknown these days. 

The internal assessment and regular sessional work presuppose a high 
level of honesty and sense of responsibility on the part of the teachers and 
others concerned with the process. If this is wanting, it is my feeling that it 
spells greater danger than the much maligned essay-type of external exami¬ 
nation. In any case, one cannot say with confidence that introduction 
of sessional and internal asse.ssment has made the examination any more 
reliable. 

Some institutions have adopted the semester and credit systems and 
along with that reorganisation of courses, more frequent assessment of stu¬ 
dents' progress through class tests, mid-semester and end-seme^er Maraina- 
tions. All these presuppose continuous work on the part of student and 
assessment of his educational attainment throughout the year rather than 
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through otie end-ol'-ihe-year examination. It also implies that a student 
who does not maintain a minimum credit has to repeat the course and if he 
performs below a certain level, he has no right to continue or to get promot¬ 
ed to the next class. In one or two institutions, T have found that the pres¬ 
sure exerted by the students union has completely negatived all these. It is 
well-nigh impossible to detain a student or to send him down even under a 
semester system. Except in the Indian Institutes of Technology, the Indian 
Institutes of Management and some other institutions more fortunately plac¬ 
ed, the system has been meeting all kinds of crises due to the pressure of 
students bodies. Even semester examinations are postponed under students 
pressure. New courses cannot begin; the assessments are late and students 
who hardly attain any passing credits still manage to sit in next higher class¬ 
es. Semester system and the process of continuous internal assessment 
have inherent merits but their introduction in the face of the pressures and 
conditions that prevail in most educational institutions have led to the 
elimination of the very features which constitute their essence. Over and 
above, paucity of staff and excessive teaching load leave the teachers with 
very little time to organise and plan semester courses and prepare adequate 
objective examinations. Merely providing questions with multiple choice 
alternatives do not necessarily make the examination good. Even the pre¬ 
paration of examination requires considerable time and skill and continu¬ 
ous process of check on its effectiveness. To achieve this, the institutions 
require an infrastructure which cannot afford to build with the very 
limited support and resources available to education. 

Though I have indicated some actual cases of diflieulties which the 
new system of examination has faced in our educational institutions, I am 
personally fully aware of the intrinsic merits and the desirability of taking 
some of the good points of the system and implementing them effectively and 
successfully. Before doing that, the new system has to be examined care¬ 
fully in the light of the dangers and blocks that stand in the way of its success¬ 
ful implementation. 

The existing system of essay-type of examination has been the most 
attacked and maligned one. It has many defects which need immediate 
remedial measures. But the very fact that in spit: of the severe criticisms 
and all pro'^ged attacks, it has managed to.continue points to its inherent 
strength. What is, therefore, required urgently is not its complete replace 
ment but taking remedial measures which are nut difficult to implement. 
One of the legitimate criticisms against it is the inadequacy of its coverage 
In an examination, the questions are set in a manner that students car 
manage to pass by omitting almost half or two-thirds of the course. Tht 
inadequacy is not due to the inherent nature of Ihe system but because o 
certain conventions and practices which have accrued to it in the course o 
time. A practice that has grown over years is that the same questions anc 
topics should not be repeated in a subsequent year. There exists almost 
kind of “ban” on repeating questions in consecutive examinations. It mean 
that students can safely leave out all the topics and questions from his pre 
paration which had featured in the preceding examination. Secondly 
there is another convention, which has almost evolved into an informal rul 
in some universities, that examinees are given sufficient choices of question, 
and the instruction to the examiners often lays down that twice the numbe 
of questions as are required to be answered by the candidate should be s' 
in the question paper. Providing such a wide choice makes guessing saf 


260 



and students easily manage to get through by highly selective reading conven¬ 
iently leaving out more than half of the syllabus. This unhealthy conven¬ 
tion has now becoine a part of the so-called “le^timate” demands of the 
students. In fact, in one of the major universities there was a walk-out 
and violent student demonstration when only eight questions instead of 
nine, as was done in the earlier years, were set and candidates were required 
to attempt four or five. The complaint of the agitating students was that 
insufficient choice had been provided. The agitation became ugly and these 
days with the public sympathy for any wrong cause taken up by the students 
and the helplessness of the government which itself is either reluctant or 
unable in providing protection to the universities against rioting students, 
the only alternative left to the university was either to close down or concede 
the "'demand” of the students. The university decided to scrap the question 
paper and set another examination with nine questions. 

.\ow, these two practices are undesirable. Drastic reduction in choice 
of questions, or its elimination altogther would ensure adequate coverage 
of the courses in the assessment. For example, if there are ten topics pres¬ 
cribed in a syllabus ten questioms. each covering one topic, should be set and 
aU of them should be compulsory. If alternatives are to be provided, each 
question should have its own alternative from the same topic rather than 
twentv questions set from different topics and allowing students to pick up 
freely eight or ten for answering. TTiis would ensure that an examinee 
will not be able to skip large portions of the syllabus and the assessment of 
his academic attainment in the course is likely to be more adequate. 


Essa\-type examination is proverbial for its unreliability. The danger 
is very real. It is my feeling that the defect can be mitigated to a consider¬ 
able e.vtent if careful planning is done before hand and certain measures are 
adopted while assessing the scripts. A careful determination of the course- 
objectives and framing the examination accordingly are essential. The teacher 
concerned should be clear in his mind as to how much of factual informa¬ 
tion he is wanting to assess, how much importance he is going to put on 
comprehension, organization of material, originality and so on. If these 
are outlined beforehand the weightage to be given on each is decided, the 
questions can then be appropriately framed and assessed. For example, 
questions on factual information would be such that there would hardly 
be any dispute regarding their evaluation. As for the rest, if one only de¬ 
fines operationally what he means by things like organization, comprehen¬ 
sion and originality and locates examples of each by analysing a sample 
ofan.s\ver papers, discusses them with the coexaminers and agrees upon them, 
there is no reason w'hy the assessment should not be more reliable. I 
would refer in this context to the procedure which is generally followed in 
psychological researches when content analysis is employed as a tool. It 
qualitative material can be quantified and reliably scored in content-analysis, 
there is no reason why outlining of course-objectives, framing of appropriate 
questions and concrete and detailed instruction for assessment would not 
considerably enhance the reliability of the essay-type of examination. In 
fact, in an ad hoc experiment that we conducted, we follovved this 
and keeping a constant check on the extent oi agreement in assessmem of 
every twenty or twenty-five scripts, it was found 

ment in the allotment of marks was extremely high. 1 . n™e 

this kind of procedure should be carefully explored and adopted if improv 
ment in the essay-type of examination itsell is to be brough a 


2(S1 



Another desirable step worth trying out is having short-answer type of 
questions rather than depending upon four-five questions with lengthy rambl¬ 
ing answers. Such questions ensure adequate coverage of the course, can 
be made more pointed and are also easier to assess. 

Marking system commonly employed in essay-type examination needs 
some modifications. A human yardstick cannot be as accurate as a micro¬ 
meter nor can it be equally constant and reliable. Human nature being 
what it is, the same material can be quite rightly allotted 55 per cent marks 
in the first assessment and if assessed later, 58 per cent. The range of 
variation may, in fact, be frequently greater. Concerned with human assess¬ 
ment, these absolute values hardly carry any meaning and one is not justified 
in saying that a person who has got 52 is necessarily superior to a person who 
has got 51 marks even though they may have taken the same examination. 
Such minute and fine discrimination is unreasonable to expect of a human 
evaluater. Therefore, better system would be to place an examinee's attain¬ 
ment in a range rather than allotting him absolute marks, i.e.. adopt a grading 
system. For example, instead of putting the mark as 54, it should be in the 
range 50-55. Similarly, instead of giving total marks, it would be better to 
fix certain ranges in various divisions and place the students appropriately 
in those ranges. The first division may comprise four ranges like (i) rare and 
exceptional (85 per cent or more). (//) high distinction <15 per cent to S5 per 
cent), (Hi) very superior (65 per cent to 75 per cent), and (iv) borderline iirst 
(60 per cent to 65 per cent) Similar range of scores can be worked out 
for the second division as well as the lowest division. 

Another remedial mea.sure which is being tried in a number of universi¬ 
ties is the system of double examiner. While independent and honest 
assessment by two examiners is likely to be more reliable than an assessment 
made by a single examiner, this system has not proved as successful because 
of some local limiting factors of the sort indicated earlier. I would cite only 
one case. In one of the universities the internal examiners had worked out 
a marvellous system for helping their favourite candidates. They would be 
assessed in a manner to ensure a discrepancy of more than 15 per cent with 
that of the external examiner, which would automatically send such case.s 
to the board of moderators for final grading. 1 n such board cases, the inter¬ 
na] examiners usually manoeuvre to have their own way to the satisfaction 
of the local influential elite. If internal examiners cannot be forced to act 
more honestly, it would be more appropriate to .send such'board' case.s 
for final decision to an entirely new panel of two examiners, both being 
external. 

Another defect that vatiates the cs-say-lype of examination is the lack 
of sincerity on the part of the examiners who often skip over the pages 
without carefully reading the answers. This tendency is accentuated when he 
is confronted with a large pile of answer scripts generally in bad hand-writing 
which is sometimes difiicuU to decipher. There is no reason why the exa¬ 
minee should not be penalised for writing illegibly. In cases where the 
writing is reasonably clear, it is essential to ensure that the examiner takes 
the trouble of reading the answers before evaluating. For this purpose, 
apart from proper supervision exercised by the senior examiners and drasti¬ 
cally limiting the number of scripts allotted to individual examiners, I would 
also suggest the system of inserting a few dummy answer books into the 
bundle of papers sent to a particular examiner. These dummy answers 
should be prepared in a manner that without reading them carefully one is 
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likely to commit gross errors in marking and thereby betraying his wilful 
negligence and casualness of work when these particular answer books are 
scrutinised by the head examiner. Besides, he may be instructed to mark 
all the gross mistakes in spelling of technical teims and names of eminent 
scholars whose research is likely to be quoted by the examinees. Some 
of these can be rendered incorrectly in a pre-planned Way so that more than 
an occasional omission in checking them would betray the examiner. What 
I am suggesting is something like “l-items” in a personality test. As in such 
tests if the errors in marking of these dummy papers are beyond certain 
limits of tolerance, the examiner concerned should be made to reassess the 
entire lot of papers under very close supervision. 

Another check to ensure that the examiners have done their work pro¬ 
perly and conscientiously would be to return the answer books to the stu¬ 
dent concerned who may discuss, if he so desires, the grading made by the 
examiner. While this would be a difficult thing to achieve in a large-scale 
public examination, it can certainly serve as a corrective in more frequently 
held class tests and terminal exeminations. Besides, the answer papers 
should not only be seen by the examinee concerned, but should be available 
to any .student in the class for scrutiny. This would desist the examiner from 
unduly pushing up or pulling down particular candidates due to extranuous 
considerations. Public secrutiny of marked answer papers by the class will 
exert tremendous pressure on the examiner concerned to work carefully and 
honestly. 

1 would conclude that any system of examination requires a sense of 
responsibility, conscientiousness and a degree of honesty to make it work. 
Absence of th'.se is seriously damaging the prevailing essay-type of exa¬ 
mination. It is my contention that w'hatever system is introduced or rules 
framed, they would be vitiated if they are not backed by a proper sense of 
duty, responsibility, devotion to work and honesty. One can have good 
rules but good rules without good intention do not work. Therefore, apart 
from certain measures that have been suggested to improve the existing sys¬ 
tem of examination from within, there should be a missionary effort to instil 
in the minds of persons concerned with assessment of answer scripts the 
importance of taking the work with a greater sense of responsibility, honesty, 
and conscientiously. Decline that seems to have set in this sector will ruin 
not only any system of evaluation, irrespective of its inherent scientific 
merits, but would destroy the entire process of education in the country. 
Crisis of character is deplorable; it is more so in the teacher. 
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jnproveinent in Bxamination 
and '’eaching 

K. S. GUPTA 


The following steps for the improvemenl of our examinations and leaching 
are suggested: 

1. Confidence on the teacher is to be greatly increased. 

2. Better social and economic stability is to be given to the teachers. 

3. Teachers who are involved in any type of corruption should be 
severely punished and removed, if necessary. 

4. Teachers should be highly honest, with high personality and above 
all blemishes of the society. Morally they should remain at the 
topmost level of the society. 

5. Much greater weighlage is to be given to the internal assessments. 
They should play the greater part of the total assessment of our 
students, since internal assessment can take into account all the 
aspects of the development of a student. 

6. The internal and external examination results are to be kept sepa¬ 
rately and .should never be combined artificially. Even addition of 
the marks of the dilTerenl subjects, without standardising the 
scores, should be avoided. Quite often the scores of Arabic, 
Persian, Urdu, Pali, Linguistics, Hindi, Sanskrit, Music are highly 
inflated. If they arc added with the scores of other subjects, the 
totals will give some false impressions. This is quite often done in 
the board and university examinations. 

7. Some of the items of internal assessment, as for example, attitude, 
interest, personality traits, etc. may be a.s.scssed in descriptive or 
qualitative terms, e.g., excellent, good, fair, moderate, tolerable, 
unsatisfactory or other such statements or grades. 

8. The internal examination is a continuous process and should be 
done by the teacher informally at every step and guidance is to be 



given accordingly. More formal internal examinations may be 
held at weekly or monthly or quarterly intervals. 

9. The external examinations should exist. But they are to be reduced 
to the minimum. B.A. part 1 examinaion should be made internal 
with immediat- eflect. B.A. part I course should not be included in 
the B.A. part 11 examination. B.A. part II examination only should 
be conducted by the university and the B.A. results (both Honours 
and Pass) are to be announced by the university based on this part 
II examin'ilion only. Part II examination only can fully justify 
the calibre of a candidate. Regarding part II examination, the can¬ 
didate will get a certificate from the college concerned. 

10. Certificates or marks sheets should show the achievements of the 
pupils in different subjects and no remarks that he has passed or 
failed or got first or second class should be shown. The achive- 
ment in each subject may be divided into five gardes, e.g.. A, B, 
C, D, E, Dipl mas are to be given to thos?. who have passed in 
60, 70 or S0%(as decided by the university) of the number of sub¬ 
ject, opted for examinations by a candidate. The number of sub¬ 
jects to be passed will depend upon the examination. As for 
example, at the B.A. part II examination a candidate will have 
to appear at four subjects. Out of these he will have to pass in any 
of the three subjects in order to gel the diploma. Re-examination 
of scripts should be abandoned. This is a force. 

11. The first and second languages should get equal importance along 
with other subjects at the B.A. examination and no special impor¬ 
tance should be given to these subjects. 

12. Questions should be mainly short answer-type questions. "Answer 
as many as you can” out of 20. 25 or 30 questions, should be the 
direction in most of the q^uestion papers. This will give the exa¬ 
minees every little chance to consult or copy, a.s they will always 
be short of time. Most of the subjects should have two papers, 
one consisting of short-answer type questions, having a duration 
of two hours and the other of the -clear cut essay type” ques¬ 
tions. having a duration of three hours. Both should cover the 
same sv llabus. 

13. At present the guards are found to be more corrupt than the 
examinees. Hence, more the guards, more the corruption. If the 
examinees know that they will have to pass any three out of four or 
five .subjects t-o get a diploma, they will be less bent upon corrup¬ 
tion. Again if any examination cannot be held due to disturbances 
created by the candidates in any exaniin'dtion centre, the examina¬ 
tion need not be taken again. The better students will have no 
hindrance to get the d'ploma, since any student will have to pass 
only 60 or 70% of the number of examination subjects. No exami¬ 
nation is to be repeated, unless it is postponed by the university. 

14. The examinations are to be held on scheduled dates at intervals 
of six months. 

15. Tabulation work should be abandoned at the B.A. Pass examination. 
Only in the Honours B.A. examination for addition of the marks 
of the Honours papers tabulation may be retained. In the B.A. 
Pass examination, the successful candidates for each subject will get 
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certificates on the basis of the results given by the head examiners. 
If they can show university pass certificates for the requisite number 
of subjects, they will get the diploma. Thus there will be no delay 
in the publication of resuks. 

Examinations, if properly organised, are sources of inspiration to the 
pupils and satisfaction to the teachers. Right use of examinations will make 
the whole educational programme a thing of beauty and joy and cause pro¬ 
gressive growth of the students. This will also improve teachers’ efficiency. 

The various informal examinations that may be devised are as follows: 
(1) observation. (2) interview, (3) oral, (4) group discussions, f5) erectivc, 
(9) activities, f6j co-curricular activities, (7) projects, (8) questionnaires, 
check list, (10) rating scale, (11) standardised scales, (12) cumulative record 
card, in addition to the written tests e.g. objective tests, short answer type 
tests, essay type tests, open book tests. 

The external examination may be of three main types : (1) Short ans¬ 
wer type, (2) Clear-cut essay type, and (3) open book type. The first two typ<..s 
are more suitable in the big public examinations. In the open book type the 
number of questions shall be one or two and the duration shall be three or 
four hours. The candidates may bring any book or written papers as they 
like. This will inspire them to c.fflect all types of materials before hand. 
Thus they will learn to collect materials from various sources and they will 
learn a lot. 

Our object is to inspire the students to learn. And this can be done to 
a great extent through examinations. Examination is subservient to educa¬ 
tion. It is a means and education is the end. 




